-- Logs begin at Wed 2021-05-19 13:23:15 UTC, end at Wed 2021-05-19 16:34:34 UTC. -- May 19 14:10:21.101056 n-d-791503-3 systemd[1]: Started Devstack devstack@n-super-cond.service. May 19 14:10:24.854011 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_db.sqlalchemy.engines [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:10:25.093217 n-d-791503-3 nova-conductor[98609]: DEBUG nova.context [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) {{(pid=98609) load_cells /opt/stack/nova/nova/context.py:464}} May 19 14:10:25.097792 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_concurrency.lockutils [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:10:25.099359 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_concurrency.lockutils [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:10:25.100174 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_concurrency.lockutils [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:10:25.102136 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_concurrency.lockutils [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:10:25.135343 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_db.sqlalchemy.engines [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:10:25.136139 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_db.sqlalchemy.engines [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:10:25.148927 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_concurrency.lockutils [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Acquired lock "singleton_lock" {{(pid=98609) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 19 14:10:25.149701 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_concurrency.lockutils [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Releasing lock "singleton_lock" {{(pid=98609) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 19 14:10:25.150429 n-d-791503-3 nova-conductor[98609]: INFO oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Starting 2 workers May 19 14:10:25.155349 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Started child 99476 {{(pid=98609) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 19 14:10:25.160500 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Started child 99477 {{(pid=98609) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 19 14:10:25.161358 n-d-791503-3 nova-conductor[99476]: INFO nova.service [-] Starting conductor node (version 23.1.0) May 19 14:10:25.161950 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Full set of CONF: {{(pid=98609) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 19 14:10:25.162375 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ******************************************************************************** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:10:25.162714 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] Configuration options gathered from: {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:10:25.163111 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:10:25.163771 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] config files: ['/etc/nova/nova.conf'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:10:25.164098 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ================================================================================ {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:10:25.164875 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] allow_resize_to_same_host = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.169857 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] arq_binding_timeout = 300 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.170369 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] block_device_allocate_retries = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.170837 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] block_device_allocate_retries_interval = 3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.173863 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cert = self.pem {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.174425 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute_driver = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.174947 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute_monitors = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.175430 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] config_dir = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.175907 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] config_drive_format = iso9660 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.176259 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.176685 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] config_source = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.177155 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] console_host = n-d-791503-3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.179129 n-d-791503-3 nova-conductor[99477]: INFO nova.service [-] Starting conductor node (version 23.1.0) May 19 14:10:25.181072 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] control_exchange = nova {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.181731 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cpu_allocation_ratio = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.182219 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] daemon = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.182809 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] debug = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.190814 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] default_access_ip_network_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.191594 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] default_availability_zone = nova {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.192265 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] default_ephemeral_format = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.193373 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.195700 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] default_schedule_zone = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.197036 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] disk_allocation_ratio = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.200750 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] enable_new_services = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.201570 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] enabled_apis = ['osapi_compute'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.202325 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] enabled_ssl_apis = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.203099 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] flat_injected = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.203781 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] force_config_drive = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.207104 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_db.sqlalchemy.engines [None req-61069e2a-fa06-4e12-a8fd-9aef6bfe9401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:10:25.207852 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] force_raw_images = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.208276 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] graceful_shutdown_timeout = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.208862 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] heal_instance_info_cache_interval = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.209457 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] host = n-d-791503-3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.210305 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.210872 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] initial_disk_allocation_ratio = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.211490 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] initial_ram_allocation_ratio = 1.5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.212969 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.213831 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] instance_build_timeout = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.215514 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] instance_delete_interval = 300 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.216222 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] instance_format = [instance: %(uuid)s] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.216771 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] instance_name_template = instance-%08x {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.217419 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] instance_usage_audit = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.218030 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] instance_usage_audit_period = month {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.218586 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.219169 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] instances_path = /opt/stack/data/nova/instances {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.221147 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] internal_service_availability_zone = internal {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.221761 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] key = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.222325 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] live_migration_retry_count = 30 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.223444 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] log_config_append = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.224050 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.225153 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] log_dir = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.226183 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] log_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.227246 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] log_options = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.234469 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] log_rotate_interval = 1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.236741 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] log_rotate_interval_type = days {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.240862 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] log_rotation_type = none {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.240862 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.240862 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.240862 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.240862 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.241271 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.241271 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] long_rpc_timeout = 1800 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.241271 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] max_concurrent_builds = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.241502 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_db.sqlalchemy.engines [None req-e4b79547-ddb0-468f-8272-8ac55d64778b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:10:25.241741 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] max_concurrent_live_migrations = 1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.242303 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] max_concurrent_snapshots = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.243404 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] max_local_block_devices = 3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.244005 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] max_logfile_count = 30 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.244555 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] max_logfile_size_mb = 200 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.245115 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] maximum_instance_delete_attempts = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.246057 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] metadata_listen = 0.0.0.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.246666 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] metadata_listen_port = 8775 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.247806 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] metadata_workers = 2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.248522 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] migrate_max_retries = -1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.249074 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] mkisofs_cmd = genisoimage {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.249799 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] my_block_storage_ip = 10.222.0.16 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.250284 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] my_ip = 10.222.0.16 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.250939 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] network_allocate_retries = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.251616 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.252320 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] osapi_compute_listen = 0.0.0.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.252889 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] osapi_compute_listen_port = 8774 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.253321 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] osapi_compute_unique_server_name_scope = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.253874 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] osapi_compute_workers = 2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.254408 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] password_length = 12 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.254973 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] periodic_enable = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.255520 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] periodic_fuzzy_delay = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.256115 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] pointer_model = usbtablet {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.256724 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] preallocate_images = none {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.257339 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] publish_errors = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.258891 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] pybasedir = /opt/stack/nova {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.259438 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ram_allocation_ratio = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.259983 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] rate_limit_burst = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.260608 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] rate_limit_except_level = CRITICAL {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.261212 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] rate_limit_interval = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.261798 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] reboot_timeout = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.262445 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] reclaim_instance_interval = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.263061 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] record = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.263601 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] report_interval = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.264170 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] rescue_timeout = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.264777 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] reserved_host_cpus = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.265375 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] reserved_host_disk_mb = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.265932 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] reserved_host_memory_mb = 512 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.266509 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] reserved_huge_pages = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.267288 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] resize_confirm_window = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.267850 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] resize_fs_using_block_device = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.268451 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] resume_guests_state_on_host_boot = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.269891 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.274600 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] rpc_response_timeout = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.274600 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] run_external_periodic_tasks = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.274600 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] running_deleted_instance_action = reap {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.274600 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] running_deleted_instance_poll_interval = 1800 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.274600 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] running_deleted_instance_timeout = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.274600 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler_instance_sync_interval = 120 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.274600 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_down_time = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.275227 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] servicegroup_driver = db {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.275227 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] shelved_offload_time = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.275227 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] shelved_poll_interval = 3600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.275837 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] shutdown_timeout = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.276239 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] source_is_ipv6 = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.276633 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ssl_only = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.277065 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] state_path = /opt/stack/data/nova {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.277485 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] sync_power_state_interval = 600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.278519 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] sync_power_state_pool_size = 1000 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.278519 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] syslog_log_facility = LOG_USER {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.278903 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] tempdir = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.279285 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] timeout_nbd = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.279910 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] transport_url = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.280651 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] update_resources_interval = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.281061 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] use_cow_images = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.281604 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] use_eventlog = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.282005 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] use_journal = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.282389 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] use_json = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.282980 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] use_rootwrap_daemon = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.283705 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] use_stderr = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.284096 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] use_syslog = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.284485 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vcpu_pin_set = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.284893 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vif_plugging_is_fatal = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.285324 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vif_plugging_timeout = 300 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.285781 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] virt_mkfs = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.286464 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] volume_usage_poll_interval = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.286620 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] watch_log_file = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.287211 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] web = /usr/share/spice-html5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:10:25.287745 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_concurrency.disable_process_locking = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.288166 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.288655 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.auth_strategy = keystone {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.289069 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.compute_link_prefix = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.289612 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.290384 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.dhcp_domain = novalocal {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.290727 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.enable_instance_password = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.291118 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.glance_link_prefix = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.291511 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.291933 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.292339 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.instance_list_per_project_cells = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.292722 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.list_records_by_skipping_down_cells = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.293110 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.local_metadata_per_cell = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.293568 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.max_limit = 1000 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.293985 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.metadata_cache_expiration = 15 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.294572 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.neutron_default_tenant_id = default {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.294977 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.use_forwarded_for = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.295368 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.use_neutron_default_nets = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.295972 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.296329 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.297572 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.297993 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.298425 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.vendordata_dynamic_targets = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.298811 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.vendordata_jsonfile_path = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.299242 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.299753 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.backend = dogpile.cache.memcached {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.300164 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.backend_argument = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.300585 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.config_prefix = cache.oslo {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.300994 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.debug_cache_backend = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.301499 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.enabled = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.302051 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.expiration_time = 600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.302478 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.memcache_dead_retry = 300 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309205 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309205 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309205 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.memcache_pool_maxsize = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309205 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309205 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309205 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.memcache_socket_timeout = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309205 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.proxies = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309778 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.tls_allowed_ciphers = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309778 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.tls_cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309778 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.tls_certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309778 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.tls_enabled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309778 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cache.tls_keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309778 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.auth_section = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.309778 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.auth_type = password {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.310493 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.311155 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.catalog_info = volumev3::publicURL {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.311579 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.311945 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.312347 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.cross_az_attach = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.312735 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.endpoint_template = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.313126 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.http_retries = 3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.313535 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.313916 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.314402 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.os_region_name = RegionOne {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.314820 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.315201 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cinder.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.315621 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.316014 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.cpu_dedicated_set = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.316402 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.cpu_shared_set = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.316789 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.image_type_exclude_list = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.317176 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.317589 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.max_concurrent_disk_ops = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.317969 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.max_disk_devices_to_attach = -1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.318369 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.318751 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.resource_provider_association_refresh = 300 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.319130 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] compute.shutdown_retry_interval = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.319544 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] conductor.workers = 2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.319952 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] console.allowed_origins = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.320383 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] console.ssl_ciphers = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.321487 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] console.ssl_minimum_version = default {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.322025 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] consoleauth.token_ttl = 600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.322341 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.322734 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.323122 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.323545 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.connect_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.323984 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.connect_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.324372 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.endpoint_override = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.324765 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.325140 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.325563 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.max_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.326416 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.min_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.326416 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.region_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.326753 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.service_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.327153 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.service_type = accelerator {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.327554 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.327915 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.status_code_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.328291 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.status_code_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.328667 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.329148 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.333366 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] cyborg.version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.333366 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.connection = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.333366 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.connection_debug = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.333366 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.connection_parameters = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.333366 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.connection_recycle_time = 3600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.333366 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.connection_trace = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.333366 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.max_overflow = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.334843 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.max_pool_size = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.334843 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.max_retries = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.334843 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.334843 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.pool_timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.334843 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.retry_interval = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.334843 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.slave_connection = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.335912 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] api_database.sqlite_synchronous = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.335912 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] devices.enabled_vgpu_types = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.335912 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.336471 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ephemeral_storage_encryption.enabled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.336672 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.337212 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.api_servers = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.337627 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.338065 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.338640 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.338905 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.connect_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.339362 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.connect_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.339820 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.debug = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.340231 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.default_trusted_certificate_ids = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.340649 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.enable_certificate_validation = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.341124 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.enable_rbd_download = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.341431 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.endpoint_override = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.341832 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.342218 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.342596 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.max_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.343078 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.min_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.343745 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.num_retries = 3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.343890 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.rbd_ceph_conf = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.345102 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.rbd_connect_timeout = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.345102 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.rbd_pool = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.345102 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.rbd_user = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.345726 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.region_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.345899 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.service_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.349197 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.service_type = image {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.349197 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.349197 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.status_code_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.349197 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.status_code_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.350120 n-d-791503-3 nova-conductor[99476]: DEBUG nova.service [None req-61069e2a-fa06-4e12-a8fd-9aef6bfe9401 None None] Creating RPC server for service conductor {{(pid=99476) start /opt/stack/nova/nova/service.py:182}} May 19 14:10:25.350335 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.350335 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.350335 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.verify_glance_signatures = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.350335 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] glance.version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.350335 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] guestfs.debug = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.350335 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.config_drive_cdrom = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.351535 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.config_drive_inject_password = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.351535 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.351535 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.enable_instance_metrics_collection = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.352316 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.enable_remotefx = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.352316 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.instances_path_share = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.352707 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.iscsi_initiator_list = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.353000 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.limit_cpu_features = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.353411 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.353935 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.354320 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.power_state_check_timeframe = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.354713 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.355112 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.355494 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.use_multipath_io = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.355883 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.volume_attach_retry_count = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.356270 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.356660 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.vswitch_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.357046 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.357563 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] mks.enabled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362013 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362013 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] image_cache.manager_interval = 2400 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362013 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] image_cache.precache_concurrency = 1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362013 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] image_cache.remove_unused_base_images = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362013 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362013 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362443 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] image_cache.subdirectory_name = _base {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362443 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.api_max_retries = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362443 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.api_retry_interval = 2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362443 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.auth_section = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.362772 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.auth_type = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.363331 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.363862 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.364408 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.365299 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.connect_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.365841 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.connect_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.366517 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.endpoint_override = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.367185 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.368267 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.368842 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.max_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.369433 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.min_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.370009 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.partition_key = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.370603 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.peer_list = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.371165 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.region_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.371921 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.serial_console_state_timeout = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.372495 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.service_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.373100 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.service_type = baremetal {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.374087 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.374651 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.status_code_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.375220 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.status_code_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.375821 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.376433 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.377004 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ironic.version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.377705 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.378303 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] key_manager.fixed_key = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.378992 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.379567 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.barbican_api_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.380144 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.barbican_endpoint = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.380766 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.barbican_endpoint_type = public {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.381386 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.barbican_region_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.381953 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.382515 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.383774 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.384380 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.384942 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.385539 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.number_of_retries = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.386105 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.retry_delay = 1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.386675 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.387247 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.387837 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.verify_ssl = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.388411 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] barbican.verify_ssl_path = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.389010 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.approle_role_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.389658 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.approle_secret_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.390580 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.391958 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.393123 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.393849 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.395409 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.396038 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.kv_mountpoint = secret {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.396618 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.kv_version = 2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.399000 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.root_token_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.400469 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.401057 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.ssl_ca_crt_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.401649 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.402290 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.use_ssl = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.403687 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.404405 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.405373 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.406039 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.406723 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.connect_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.407329 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.connect_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.407927 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.endpoint_override = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.408332 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.408721 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.409117 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.max_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.409520 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.min_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.410097 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.region_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.410630 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.service_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.411396 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.service_type = identity {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.411955 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.412487 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.status_code_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.413065 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.status_code_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.413590 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.414019 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.414420 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] keystone.version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.414929 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.connection_uri = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.415334 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.cpu_mode = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.415898 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.cpu_model_extra_flags = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.416507 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.cpu_models = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.416918 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.device_detach_attempts = 8 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.417339 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.device_detach_timeout = 20 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.417734 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.disk_cachemodes = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.418114 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.disk_prefix = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.418740 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.enabled_perf_events = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.419446 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.file_backed_memory = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.419595 n-d-791503-3 nova-conductor[99476]: DEBUG nova.service [None req-61069e2a-fa06-4e12-a8fd-9aef6bfe9401 None None] Join ServiceGroup membership for this service conductor {{(pid=99476) start /opt/stack/nova/nova/service.py:199}} May 19 14:10:25.420133 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.gid_maps = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.420648 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.hw_disk_discard = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.421133 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.hw_machine_type = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.421689 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.images_rbd_ceph_conf = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.422184 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.422770 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.423273 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.images_rbd_glance_store_name = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.423456 n-d-791503-3 nova-conductor[99477]: DEBUG nova.service [None req-e4b79547-ddb0-468f-8272-8ac55d64778b None None] Creating RPC server for service conductor {{(pid=99477) start /opt/stack/nova/nova/service.py:182}} May 19 14:10:25.423878 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.images_rbd_pool = rbd {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.424397 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.images_type = default {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.424878 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.images_volume_group = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.425392 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.inject_key = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.425654 n-d-791503-3 nova-conductor[99476]: DEBUG nova.servicegroup.drivers.db [None req-61069e2a-fa06-4e12-a8fd-9aef6bfe9401 None None] DB_Driver: join new ServiceGroup member n-d-791503-3 to the conductor group, service = {{(pid=99476) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 19 14:10:25.425992 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.inject_partition = -2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.426466 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.inject_password = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.427094 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.iscsi_iface = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.427681 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.iser_use_multipath = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.428287 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_bandwidth = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.428886 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.429516 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_downtime = 500 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.430624 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.431219 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.431821 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_inbound_addr = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.432444 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.433041 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_permit_post_copy = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.433657 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_scheme = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.434280 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_timeout_action = abort {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.434902 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_tunnelled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.435512 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_uri = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.436102 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.live_migration_with_native_tls = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.436703 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.max_queues = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.437441 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.438043 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.nfs_mount_options = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.438885 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.439490 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.440179 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.num_iser_scan_tries = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.440767 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.num_memory_encrypted_guests = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.441435 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.442045 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.num_pcie_ports = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.442660 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.num_volume_scan_tries = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.443259 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.pmem_namespaces = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.443848 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.quobyte_client_cfg = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.444566 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.445210 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rbd_connect_timeout = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.446481 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.447090 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.447693 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rbd_secret_uuid = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.448912 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rbd_user = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.449544 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.450179 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.remote_filesystem_transport = ssh {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.450783 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rescue_image_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.451425 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rescue_kernel_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.452022 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rescue_ramdisk_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.452631 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.453280 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.rx_queue_size = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.453906 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.smbfs_mount_options = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.454608 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.455231 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.snapshot_compression = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.455823 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.snapshot_image_format = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.456512 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.457426 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.sparse_logical_volumes = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.458041 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.swtpm_enabled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.459817 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.swtpm_group = tss {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.460558 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.swtpm_user = tss {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.461162 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.sysinfo_serial = unique {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.462079 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.tx_queue_size = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.462840 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.uid_maps = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.463419 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.use_virtio_for_bridges = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.464036 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.virt_type = kvm {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.464640 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.volume_clear = zero {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.465277 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.volume_clear_size = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.465890 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.volume_use_multipath = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.466630 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.vzstorage_cache_path = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.467225 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.467813 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.vzstorage_mount_group = qemu {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.468404 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.vzstorage_mount_opts = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.469021 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.469751 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.470363 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.vzstorage_mount_user = stack {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.470952 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.471698 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.auth_section = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.472364 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.auth_type = password {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.472947 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.473556 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.474181 n-d-791503-3 nova-conductor[99477]: DEBUG nova.service [None req-e4b79547-ddb0-468f-8272-8ac55d64778b None None] Join ServiceGroup membership for this service conductor {{(pid=99477) start /opt/stack/nova/nova/service.py:199}} May 19 14:10:25.474309 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.474765 n-d-791503-3 nova-conductor[99477]: DEBUG nova.servicegroup.drivers.db [None req-e4b79547-ddb0-468f-8272-8ac55d64778b None None] DB_Driver: join new ServiceGroup member n-d-791503-3 to the conductor group, service = {{(pid=99477) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 19 14:10:25.475160 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.connect_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.475719 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.connect_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.476309 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.default_floating_pool = public {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.477426 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.endpoint_override = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.478001 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.extension_sync_interval = 600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.478604 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.http_retries = 3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.479184 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.479758 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.480353 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.max_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.480938 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.481548 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.min_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.482147 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.ovs_bridge = br-int {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.482722 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.physnets = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.483277 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.region_name = RegionOne {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.483860 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.service_metadata_proxy = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.484437 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.service_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.485052 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.service_type = network {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.485508 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.485904 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.status_code_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.486308 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.status_code_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.486700 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.487146 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.487528 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] neutron.version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.487933 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] notifications.bdms_in_notifications = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.488340 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] notifications.default_level = INFO {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.488745 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] notifications.notification_format = unversioned {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.489130 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] notifications.notify_on_state_change = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.489561 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.489965 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] pci.alias = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.490386 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] pci.passthrough_whitelist = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.490828 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.auth_section = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.491238 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.auth_type = password {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.491718 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.auth_url = http://10.222.0.16/identity {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.492100 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.492495 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.493421 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.493966 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.connect_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.494348 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.connect_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.494763 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.default_domain_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.495148 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.default_domain_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.495530 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.domain_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.495911 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.domain_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.496288 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.endpoint_override = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.496656 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.497122 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.497524 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.max_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.497905 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.min_version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.498298 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.password = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.498703 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.project_domain_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.499096 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.project_domain_name = Default {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.499483 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.project_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.499971 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.project_name = service {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.500370 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.region_name = RegionOne {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.500747 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.service_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.501141 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.service_type = placement {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.501546 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.501924 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.status_code_retries = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.502309 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.status_code_retry_delay = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.502685 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.system_scope = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.503097 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.503533 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.trust_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.503874 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.user_domain_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.504234 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.user_domain_name = Default {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.504609 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.user_id = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.505031 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.username = placement {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.505488 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.505869 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] placement.version = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.507224 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] powervm.disk_driver = localdisk {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.507224 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] powervm.proc_units_factor = 0.1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.507224 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] powervm.volume_group_name = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.507224 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.cores = 20 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.508348 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.count_usage_from_placement = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.508502 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.508836 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.injected_file_content_bytes = 10240 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.509241 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.injected_file_path_length = 255 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.509631 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.injected_files = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.510027 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.instances = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.510422 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.key_pairs = 100 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.510817 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.metadata_items = 128 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.511497 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.ram = 51200 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.511695 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.recheck_quota = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.511965 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.server_group_members = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.512351 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] quota.server_groups = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.512742 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] rdp.enabled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.513477 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.513937 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.514446 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.514646 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.image_metadata_prefilter = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.515019 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.515414 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.max_attempts = 3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.515799 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.max_placement_results = 1000 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.516352 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.516747 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.query_placement_for_availability_zone = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.517131 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.query_placement_for_image_type_support = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.517542 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.517993 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] scheduler.workers = 2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.518379 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.518874 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.519219 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.519608 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.519998 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.520392 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.520880 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.521255 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.521625 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.host_subset_size = 1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.522002 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.522454 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.522927 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.isolated_hosts = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.523319 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.isolated_images = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.523760 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.524484 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.524725 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.525378 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.525670 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.526098 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.526477 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.526867 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.527306 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.track_instance_changes = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.527728 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.528381 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] metrics.required = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.528775 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] metrics.weight_multiplier = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.529259 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.529570 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] metrics.weight_setting = [] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.530185 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.530569 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] serial_console.enabled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.531001 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] serial_console.port_range = 10000:20000 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.531397 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.531790 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.532178 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] serial_console.serialproxy_port = 6083 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.532570 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.auth_section = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.532994 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.auth_type = password {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.533395 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.533795 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.534178 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.534660 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.534927 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.535299 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.send_service_user_token = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.535677 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.536051 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] service_user.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.536444 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] spice.agent_enabled = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.536832 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] spice.enabled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.537511 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.538015 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.538405 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] spice.html5proxy_port = 6082 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.538851 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] spice.server_listen = 127.0.0.1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.539223 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.540181 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] upgrade_levels.baseapi = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.540562 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] upgrade_levels.cert = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.540967 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] upgrade_levels.compute = auto {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.541374 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] upgrade_levels.conductor = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.541777 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] upgrade_levels.scheduler = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.542169 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vendordata_dynamic_auth.auth_section = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.542569 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vendordata_dynamic_auth.auth_type = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.542980 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vendordata_dynamic_auth.cafile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.543320 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vendordata_dynamic_auth.certfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.543701 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.544077 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vendordata_dynamic_auth.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.544517 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vendordata_dynamic_auth.keyfile = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.544873 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.545211 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vendordata_dynamic_auth.timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.545647 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.api_retry_count = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.546028 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.ca_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.546429 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.cache_prefix = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.546793 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.cluster_name = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.547290 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.connection_pool_size = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.547672 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.console_delay_seconds = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.548042 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.datastore_regex = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.548426 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.host_ip = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.548801 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.host_password = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.549261 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.host_port = 443 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.549598 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.host_username = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.549977 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.insecure = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.550352 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.integration_bridge = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.550737 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.maximum_objects = 100 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.551129 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.pbm_default_policy = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.551524 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.pbm_enabled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.551903 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.pbm_wsdl_location = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.552327 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.552710 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.serial_port_proxy_uri = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.553100 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.serial_port_service_uri = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.553806 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.task_poll_interval = 0.5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.553806 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.use_linked_clone = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.555794 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.vnc_keymap = en-us {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.555794 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.vnc_port = 5900 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.555794 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vmware.vnc_port_total = 10000 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.555794 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.auth_schemes = ['none'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.556330 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.enabled = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.556481 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.556855 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.557270 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.novncproxy_port = 6080 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.557712 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.server_listen = 127.0.0.1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.558124 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.558524 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.vencrypt_ca_certs = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.558903 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.vencrypt_client_cert = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.559278 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] vnc.vencrypt_client_key = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.559697 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.560082 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.560467 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.560850 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.disable_native_luksv1 = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.561248 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.disable_rootwrap = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.561633 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.enable_numa_live_migration = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.562013 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.562393 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.562773 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.563194 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.rbd_volume_local_attach = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.563569 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.564045 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.564450 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.client_socket_timeout = 900 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.564842 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.default_pool_size = 1000 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.565248 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.keep_alive = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.565788 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.max_header_line = 16384 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.566024 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.secure_proxy_ssl_header = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.566403 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.ssl_ca_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.566909 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.ssl_cert_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.567291 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.ssl_key_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.567676 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.tcp_keepidle = 600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.568084 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.568475 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] zvm.ca_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.568853 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] zvm.cloud_connector_url = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.569444 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.569834 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] zvm.reachable_timeout = 300 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.570277 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.enforce_new_defaults = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.571281 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.enforce_scope = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.571740 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.policy_default_rule = default {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.572192 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.572603 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.policy_file = policy.yaml {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.573046 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.573526 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.573924 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.574304 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.574686 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.575121 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.575863 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.connection_string = messaging:// {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.576099 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.enabled = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.576518 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.es_doc_type = notification {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.576920 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.es_scroll_size = 10000 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.577339 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.es_scroll_time = 2m {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.577726 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.filter_error_trace = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.578118 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.hmac_keys = SECRET_KEY {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.578513 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.sentinel_service_name = mymaster {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.578908 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.socket_timeout = 0.1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.579285 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] profiler.trace_sqlalchemy = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.579810 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.backend = sqlalchemy {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.580133 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.connection = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.580521 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.connection_debug = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.580917 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.connection_parameters = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.581347 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.connection_recycle_time = 3600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.581732 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.connection_trace = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.582123 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.db_inc_retry_interval = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.582507 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.db_max_retries = 20 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.582887 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.db_max_retry_interval = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.583266 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.db_retry_interval = 1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.583655 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.max_overflow = 50 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.584034 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.max_pool_size = 5 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.584423 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.max_retries = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.584806 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.mysql_enable_ndb = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.585224 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.585796 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.pool_timeout = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.586129 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.retry_interval = 10 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.586919 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.slave_connection = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.587393 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.sqlite_synchronous = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.587685 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.use_db_reconnect = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.588069 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] database.use_tpool = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.588498 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] remote_debug.host = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.588883 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] remote_debug.port = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.590573 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.590573 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.590573 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.590573 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.593305 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.593305 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.593305 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.593305 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.593305 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.593305 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.594474 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.594474 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.594474 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.594888 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.595038 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.595335 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.595729 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.596153 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.596487 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.596877 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.597325 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.597775 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.ssl = False {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.598217 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.598620 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.599045 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.599455 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_rabbit.ssl_version = {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.599915 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.600303 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_notifications.retry = -1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.600952 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.601167 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_messaging_notifications.transport_url = **** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.601621 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_reports.file_event_handler = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.602032 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.602408 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] oslo_reports.log_dir = None {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:10:25.602724 n-d-791503-3 nova-conductor[98609]: DEBUG oslo_service.service [None req-4410c98c-1f4b-45ca-a26f-1a91d2d17755 None None] ******************************************************************************** {{(pid=98609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:13:25.399752 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:13:25.467482 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:13:26.428518 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38534. May 19 14:13:26.491303 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38536. May 19 14:16:26.420382 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:16:26.488938 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:16:27.443382 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38606. May 19 14:16:27.510339 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38608. May 19 14:19:27.442949 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:19:27.509084 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:19:28.497046 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38686. May 19 14:19:28.551443 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38688. May 19 14:20:38.086545 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_db.sqlalchemy.engines [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Parent process 98609 forked (99476) with an open database connection, which is being discarded and recreated. {{(pid=99476) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} May 19 14:20:39.769517 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Took 1.67 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:20:39.884531 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:39.890517 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:39.920986 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_db.sqlalchemy.engines [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:20:40.307228 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:40.310294 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:40.311696 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:40.312276 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:40.353097 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_db.sqlalchemy.engines [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:20:40.389205 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:20:40.400457 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for user bd92f567e5904ced8972590def36011f and project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:20:40.421836 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 0b95994d-b4cb-4703-bd6c-881675e580fa] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:20:40.421836 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:40.421836 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:40.576628 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 0b95994d-b4cb-4703-bd6c-881675e580fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:20:40.582791 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:40.583781 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:40.911923 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:40.913362 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:40.914506 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc295020-de41-41c0-8b7a-2cea0b0252bb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Acquired lock "compute-rpcapi-router" {{(pid=99476) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 19 14:20:40.917649 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-76948be4-0ffb-46cb-94b7-5ddfdca41377 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:40.918967 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-76948be4-0ffb-46cb-94b7-5ddfdca41377 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:40.921591 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-76948be4-0ffb-46cb-94b7-5ddfdca41377 None None] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:40.923054 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-76948be4-0ffb-46cb-94b7-5ddfdca41377 None None] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:41.002072 n-d-791503-3 nova-conductor[99476]: INFO nova.compute.rpcapi [None req-76948be4-0ffb-46cb-94b7-5ddfdca41377 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 19 14:20:41.003428 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-76948be4-0ffb-46cb-94b7-5ddfdca41377 None None] Releasing lock "compute-rpcapi-router" {{(pid=99476) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 19 14:20:43.912715 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_db.sqlalchemy.engines [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Parent process 98609 forked (99477) with an open database connection, which is being discarded and recreated. {{(pid=99477) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} May 19 14:20:45.174185 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Took 1.25 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:20:45.226461 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:45.231818 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:45.260269 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_db.sqlalchemy.engines [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:20:45.660781 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:45.664192 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:45.665203 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:45.665697 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:45.700204 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_db.sqlalchemy.engines [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:20:45.722038 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Getting quotas for project 7e3a0ea9b8be41ffa9d135ceae1c00c4. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:20:45.729010 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Getting quotas for user 4dfb6539bcc54d4f912f976c12d96dee and project 7e3a0ea9b8be41ffa9d135ceae1c00c4. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:20:45.750752 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] [instance: ad2bacb7-d98d-43df-879e-048b88b136a4] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:20:45.752837 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:45.754482 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:45.837033 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] [instance: ad2bacb7-d98d-43df-879e-048b88b136a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:20:45.842912 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:45.843510 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:46.121490 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:46.122373 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:46.123627 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-99f124b6-2061-4674-bb41-dccd1cd7c247 tempest-AggregatesAdminTestJSON-1680439194 tempest-AggregatesAdminTestJSON-1680439194-project] Acquired lock "compute-rpcapi-router" {{(pid=99477) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 19 14:20:46.128530 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-318a028e-641b-41a0-8779-d7eae4857638 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:46.128530 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-318a028e-641b-41a0-8779-d7eae4857638 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:46.128530 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-318a028e-641b-41a0-8779-d7eae4857638 None None] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:20:46.128530 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-318a028e-641b-41a0-8779-d7eae4857638 None None] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:20:46.171255 n-d-791503-3 nova-conductor[99477]: INFO nova.compute.rpcapi [None req-318a028e-641b-41a0-8779-d7eae4857638 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 19 14:20:46.175570 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-318a028e-641b-41a0-8779-d7eae4857638 None None] Releasing lock "compute-rpcapi-router" {{(pid=99477) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 19 14:21:16.342272 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:16.345248 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:17.541526 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Took 1.12 seconds to select destinations for 2 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:21:17.588570 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:17.588977 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:17.829358 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:17.830183 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:18.052963 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:18.053325 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:18.054187 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:18.054590 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:18.087624 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:21:18.092634 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for user bd92f567e5904ced8972590def36011f and project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:21:18.106526 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 77d6fb96-549f-4570-943c-51da485c748e] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:21:18.108152 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:18.108741 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:18.187347 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 77d6fb96-549f-4570-943c-51da485c748e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:21:18.190553 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:18.191707 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:18.646981 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:18.647650 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:18.667180 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: d523f55d-85f5-435f-92b5-0dead98e8a04] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:21:18.671746 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance_group [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lazy-loading 'hosts' on InstanceGroup uuid d7963f0b-5898-440a-9780-ed4757adc98b {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} May 19 14:21:18.682521 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:18.682942 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:18.723430 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:21:18.765689 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:18.767463 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:18.785287 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: d523f55d-85f5-435f-92b5-0dead98e8a04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:21:18.786920 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:18.787725 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:19.110049 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:19.111061 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:19.112394 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:19.113074 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:19.159617 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Getting quotas for project eb345679acf5446eb0b4c2d255daf1c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:21:19.167103 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:19.167103 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-75f11a6b-ce31-4b94-8607-bd4f78b60f31 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:19.177885 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Getting quotas for user cf8d497085c440c1b4b2457e587167b9 and project eb345679acf5446eb0b4c2d255daf1c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:21:19.228066 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] [instance: bd48a37b-d492-4955-a371-871c3310fa28] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:21:19.232150 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:19.232903 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:19.360123 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] [instance: bd48a37b-d492-4955-a371-871c3310fa28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:21:19.361880 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:19.362464 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:19.738527 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:19.740089 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-64bc4a53-fc61-47da-92c4-27230ccdccd4 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:30.851597 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Took 0.96 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:21:30.905565 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:30.906895 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:31.319236 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:31.320052 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:31.322653 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:31.326609 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:31.385986 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Getting quotas for project 09d6a3672f4c4a1883648516c7480712. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:21:31.425003 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Getting quotas for user ef86f3062ee24e0089f9b088d0658058 and project 09d6a3672f4c4a1883648516c7480712. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:21:31.474952 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] [instance: b00f415b-afe0-475d-b092-2e0ee17c9eff] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:21:31.478227 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:31.478886 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:31.622268 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] [instance: b00f415b-afe0-475d-b092-2e0ee17c9eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:21:31.622268 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:31.622268 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:21:32.156646 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:21:32.157660 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-4b7ca2db-86c8-4d85-8ce5-ccaf6a8825eb tempest-VolumesAdminNegativeTest-701132716 tempest-VolumesAdminNegativeTest-701132716-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:10.819188 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:10.819983 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:12.660366 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Took 1.68 seconds to select destinations for 2 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:22:12.727017 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:12.727967 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:13.098176 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:13.098591 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:13.297226 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:13.298593 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:13.300256 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:13.300919 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:13.335245 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:22:13.346529 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for user bd92f567e5904ced8972590def36011f and project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:22:13.364815 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: d73945d7-7b3c-40d1-b979-9af1ad2fcc1c] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:22:13.365837 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:13.366348 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:13.447844 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: d73945d7-7b3c-40d1-b979-9af1ad2fcc1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:22:13.449263 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:13.449682 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:13.695724 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f3df9ea4-47b7-4604-a89f-1ccb95f1513a tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:22:13.697146 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f3df9ea4-47b7-4604-a89f-1ccb95f1513a tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:13.698116 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f3df9ea4-47b7-4604-a89f-1ccb95f1513a tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:13.757139 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Took 2.84 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:22:13.801991 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:13.802634 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:13.970979 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:13.971155 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:14.000066 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 1b0fb75a-940d-4204-8950-f221e9792601] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:22:14.000589 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance_group [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lazy-loading 'hosts' on InstanceGroup uuid 5a8c1bc6-8849-4dc2-844f-cd2022b225b2 {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} May 19 14:22:14.041262 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:14.042082 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:14.241931 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 1b0fb75a-940d-4204-8950-f221e9792601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:22:14.245112 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:14.246376 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:14.265099 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:14.269387 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:14.271468 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:14.276792 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:14.340706 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Getting quotas for project 86ed0fd3cec5401d87c4c15d5f760549. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:22:14.350395 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Getting quotas for user 101cf4ec142848c9a8c7780fd2163db0 and project 86ed0fd3cec5401d87c4c15d5f760549. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:22:14.372957 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] [instance: 3cdea6bd-0d9c-4b61-8e6a-4bc8a959298b] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:22:14.373795 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:14.374400 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:14.536418 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] [instance: 3cdea6bd-0d9c-4b61-8e6a-4bc8a959298b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:22:14.538051 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:14.538348 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:14.733999 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:14.738011 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-85ae8997-34e4-4bed-a8d2-d3ed36159cfb tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:15.012030 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:15.013929 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6c35ac7d-b96d-487c-8bcc-32dfa38610f6 tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:15.400696 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-f3df9ea4-47b7-4604-a89f-1ccb95f1513a tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Created allocations for migration a828f437-2c05-4f02-8e13-8e2052b4d225 on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99477) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:22:16.233447 n-d-791503-3 nova-conductor[99477]: DEBUG nova.scheduler.utils [None req-f3df9ea4-47b7-4604-a89f-1ccb95f1513a tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] [instance: bd48a37b-d492-4955-a371-871c3310fa28] Instance allocations successfully created on destination node 1393a5cf-e110-4cb7-bac4-fa53d5684d2a: {'allocations': {'1393a5cf-e110-4cb7-bac4-fa53d5684d2a': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99477) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 19 14:22:16.242896 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-f3df9ea4-47b7-4604-a89f-1ccb95f1513a tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lazy-loading 'resources' on Instance uuid bd48a37b-d492-4955-a371-871c3310fa28 {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:22:16.258074 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-f3df9ea4-47b7-4604-a89f-1ccb95f1513a tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lazy-loading 'pci_requests' on Instance uuid bd48a37b-d492-4955-a371-871c3310fa28 {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:22:17.463384 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Took 1.33 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:22:17.526539 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:17.539608 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:18.075927 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:18.076521 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:18.078184 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:18.080490 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:18.140557 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Getting quotas for project 8b3cf153a24c4735b80265a4433af3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:22:18.152751 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Getting quotas for user 65f6365d1f4741f3905c5c8efbb1a533 and project 8b3cf153a24c4735b80265a4433af3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:22:18.186356 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] [instance: ee418793-a8b5-45eb-a1c6-82f4a5befcef] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:22:18.203548 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:18.203548 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:18.315334 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] [instance: ee418793-a8b5-45eb-a1c6-82f4a5befcef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:22:18.317943 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:18.323520 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:18.674112 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.live_migrate [None req-f3df9ea4-47b7-4604-a89f-1ccb95f1513a tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] [instance: bd48a37b-d492-4955-a371-871c3310fa28] Start binding ports on destination host: n-h2-791503-3 {{(pid=99477) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 19 14:22:18.797061 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:18.798629 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0d8e0470-83be-4611-9336-57e2942b2882 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:58.376866 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:22:58.423299 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:58.423701 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:58.732575 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:58.732991 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:58.737771 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:58.738185 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:58.783438 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Getting quotas for project 98c169436e9742548edcc0af812f7b40. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:22:58.792383 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Getting quotas for user 1b9d59a0f95d42eb9fa91dd5641e1803 and project 98c169436e9742548edcc0af812f7b40. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:22:58.821652 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] [instance: ecfe5fab-84b2-488d-ab44-27359d349564] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:22:58.824599 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:58.825027 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:58.833037 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:22:58.886773 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:58.887448 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:59.012572 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] [instance: ecfe5fab-84b2-488d-ab44-27359d349564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:22:59.014094 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:59.014608 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:59.199952 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:59.200504 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:59.204491 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:59.204491 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:59.252161 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Getting quotas for project eb345679acf5446eb0b4c2d255daf1c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:22:59.273645 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Getting quotas for user cf8d497085c440c1b4b2457e587167b9 and project eb345679acf5446eb0b4c2d255daf1c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:22:59.310654 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] [instance: d89cd265-b38d-47c1-a97f-38516f405271] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:22:59.313308 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:59.319738 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:59.556267 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:59.558988 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] [instance: d89cd265-b38d-47c1-a97f-38516f405271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:22:59.561583 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2a84788b-2d26-4afb-8125-80a269d61eb0 tempest-TenantUsagesTestJSON-1206960024 tempest-TenantUsagesTestJSON-1206960024-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:22:59.565788 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:22:59.566590 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:00.125926 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:00.126629 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f832c89-07fe-4bce-b25d-9abc95d8f834 tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:01.766412 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:23:01.802217 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:01.802872 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:02.096986 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:02.098420 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:02.105211 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:02.110265 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:02.196532 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Getting quotas for project 86ed0fd3cec5401d87c4c15d5f760549. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:23:02.220678 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Getting quotas for user 101cf4ec142848c9a8c7780fd2163db0 and project 86ed0fd3cec5401d87c4c15d5f760549. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:23:02.270334 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] [instance: ac301f10-3550-4da8-9b7c-223723f7fa8c] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:23:02.271796 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:02.272400 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:02.313634 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-259f4166-ac6e-40a9-a746-125a8da30813 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:23:02.315052 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-259f4166-ac6e-40a9-a746-125a8da30813 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:02.315623 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-259f4166-ac6e-40a9-a746-125a8da30813 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:02.384444 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] [instance: ac301f10-3550-4da8-9b7c-223723f7fa8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:23:02.388133 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:02.389373 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:02.724257 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:02.727084 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a65b55a2-bc84-4893-96da-d96a8b4b7b2a tempest-DeleteServersAdminTestJSON-1316459734 tempest-DeleteServersAdminTestJSON-1316459734-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:02.950821 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Took 0.96 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:23:03.041482 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:03.042426 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:03.294758 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:03.295711 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:03.298302 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:03.298906 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:03.356728 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:23:03.395481 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for user bd92f567e5904ced8972590def36011f and project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:23:03.449623 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 7cd767ca-cf7e-460a-8d35-2d1c120203cc] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:23:03.456430 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:03.459123 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:03.550465 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 7cd767ca-cf7e-460a-8d35-2d1c120203cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:23:03.557418 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:03.560235 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:03.865875 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-259f4166-ac6e-40a9-a746-125a8da30813 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Created allocations for migration 78b00cb3-5699-4c83-9c0b-f57650d3a0b8 on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99477) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:23:04.043508 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:04.044393 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-726e9671-a1b6-4734-94ea-867fea3e40c5 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:04.361152 n-d-791503-3 nova-conductor[99477]: DEBUG nova.scheduler.utils [None req-259f4166-ac6e-40a9-a746-125a8da30813 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] [instance: ee418793-a8b5-45eb-a1c6-82f4a5befcef] Instance allocations successfully created on destination node 7df066a6-f733-45d1-9e5a-5ab4cb09500f: {'allocations': {'7df066a6-f733-45d1-9e5a-5ab4cb09500f': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99477) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 19 14:23:04.361152 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-259f4166-ac6e-40a9-a746-125a8da30813 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lazy-loading 'resources' on Instance uuid ee418793-a8b5-45eb-a1c6-82f4a5befcef {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:23:04.365956 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-259f4166-ac6e-40a9-a746-125a8da30813 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lazy-loading 'pci_requests' on Instance uuid ee418793-a8b5-45eb-a1c6-82f4a5befcef {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:23:05.665569 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.live_migrate [None req-259f4166-ac6e-40a9-a746-125a8da30813 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] [instance: ee418793-a8b5-45eb-a1c6-82f4a5befcef] Start binding ports on destination host: n-h1-791503-3 {{(pid=99477) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 19 14:23:14.211053 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Took 1.17 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:23:14.257948 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:14.258801 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:14.597844 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:14.598819 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:14.599829 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:14.600260 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:14.706254 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Getting quotas for project 900089301d854c3693ff2e99b849722d. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:23:14.719031 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Getting quotas for user 601900bf0ae447e2969d4d928a96497c and project 900089301d854c3693ff2e99b849722d. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:23:14.810211 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] [instance: 5618248f-d9d5-4b4a-81b7-5d548389ff79] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:23:14.817735 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:14.819186 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:14.966049 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] [instance: 5618248f-d9d5-4b4a-81b7-5d548389ff79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:23:14.968614 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:14.969144 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:15.470035 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:15.470889 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b9b8a5-47a1-4b7c-afe9-37b920cb4b7a tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:19.289415 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:23:19.337344 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:19.338338 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:19.560326 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:19.560751 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:19.562046 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:19.562656 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:19.583627 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Getting quotas for project 511b8c4c00ef4bbbbb6e6ea2e7498a8b. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:23:19.589673 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Getting quotas for user e93e3943bcc2492aa2438ea7a86aa5c3 and project 511b8c4c00ef4bbbbb6e6ea2e7498a8b. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:23:19.613521 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] [instance: 699750a6-fa26-4c5c-a2b2-24169dae3a1f] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:23:19.615127 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:19.615941 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:19.743781 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] [instance: 699750a6-fa26-4c5c-a2b2-24169dae3a1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:23:19.745540 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:19.746881 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:20.018029 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:20.019242 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50e6e145-d5e4-4ff8-941c-40d98f428519 tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:36.537457 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:23:36.584421 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:36.585250 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:36.815727 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:36.816636 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:36.817689 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:36.818916 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:36.842942 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Getting quotas for project 8b3cf153a24c4735b80265a4433af3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:23:36.849849 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Getting quotas for user 65f6365d1f4741f3905c5c8efbb1a533 and project 8b3cf153a24c4735b80265a4433af3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:23:36.865763 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] [instance: 6bd75c6b-055e-4860-9751-15e7e7e1dfbd] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:23:36.867285 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:36.867955 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:36.976445 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] [instance: 6bd75c6b-055e-4860-9751-15e7e7e1dfbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:23:36.978039 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:36.978489 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:37.311516 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:37.311962 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d483c530-e293-4471-95fb-1117adf7331e tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:39.398088 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:23:39.446500 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:39.447044 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:39.716274 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:39.723079 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:39.725213 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:39.726334 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:39.766925 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:23:39.781544 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for user bd92f567e5904ced8972590def36011f and project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:23:39.810478 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: da7e688e-3488-44f5-b428-78c1f338b8cc] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:23:39.813508 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:39.815035 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:39.925452 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: da7e688e-3488-44f5-b428-78c1f338b8cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:23:39.926911 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:39.927690 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:40.348365 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:40.349716 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f72d3c84-a85f-4b7d-b1c9-6cf420dbda4e tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:47.130671 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f12323af-a690-4c6f-b634-935f431b002e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:23:47.131632 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f12323af-a690-4c6f-b634-935f431b002e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:47.132457 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f12323af-a690-4c6f-b634-935f431b002e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:48.517161 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-f12323af-a690-4c6f-b634-935f431b002e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Created allocations for migration e523ab04-fa61-4f16-92b0-6b43e8163429 on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:23:48.934299 n-d-791503-3 nova-conductor[99476]: DEBUG nova.scheduler.utils [None req-f12323af-a690-4c6f-b634-935f431b002e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] [instance: d89cd265-b38d-47c1-a97f-38516f405271] Instance allocations successfully created on destination node 1393a5cf-e110-4cb7-bac4-fa53d5684d2a: {'allocations': {'1393a5cf-e110-4cb7-bac4-fa53d5684d2a': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99476) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 19 14:23:48.934753 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-f12323af-a690-4c6f-b634-935f431b002e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lazy-loading 'resources' on Instance uuid d89cd265-b38d-47c1-a97f-38516f405271 {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:23:48.941930 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-f12323af-a690-4c6f-b634-935f431b002e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lazy-loading 'pci_requests' on Instance uuid d89cd265-b38d-47c1-a97f-38516f405271 {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:23:50.325109 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.live_migrate [None req-f12323af-a690-4c6f-b634-935f431b002e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] [instance: d89cd265-b38d-47c1-a97f-38516f405271] Start binding ports on destination host: n-h2-791503-3 {{(pid=99476) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 19 14:23:56.486342 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:23:56.538383 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:56.538383 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:56.792963 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:56.793805 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:56.796826 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:56.798103 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:56.865888 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Getting quotas for project 511b8c4c00ef4bbbbb6e6ea2e7498a8b. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:23:56.881907 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Getting quotas for user e93e3943bcc2492aa2438ea7a86aa5c3 and project 511b8c4c00ef4bbbbb6e6ea2e7498a8b. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:23:56.909916 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] [instance: b8ab548f-6722-4a56-b06a-86c56a1db583] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:23:56.911793 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:56.912981 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:57.051744 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] [instance: b8ab548f-6722-4a56-b06a-86c56a1db583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:23:57.053388 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:57.053803 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:57.079698 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:23:57.144830 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:57.144830 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:57.449858 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:57.453023 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-502654f3-c618-4691-8e94-34bbccdf89bd tempest-ServersAdminNegativeTestJSON-1286895127 tempest-ServersAdminNegativeTestJSON-1286895127-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:57.651185 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:57.651185 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:57.651185 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:57.651185 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:57.709381 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Getting quotas for project 3cbc018d1b9a4bc795b35b4a3312693d. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:23:57.728640 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Getting quotas for user 579920d83e2c423fbcf06f86d0585d65 and project 3cbc018d1b9a4bc795b35b4a3312693d. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:23:57.774748 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] [instance: 7806381f-4623-4226-bc26-48ff38a39e47] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:23:57.778990 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:57.779682 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:57.999543 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] [instance: 7806381f-4623-4226-bc26-48ff38a39e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:23:58.000814 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:58.001361 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:23:58.415689 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:23:58.416358 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8889b196-f473-4f5b-b718-be6475c5cc79 tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:10.197452 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:24:10.251986 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:10.252992 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:10.639579 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:10.639579 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:10.639579 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:10.639579 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:10.675773 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Getting quotas for project fa76fcc9e30b43e5bc07c834812eb288. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:24:10.689003 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Getting quotas for user 5cf6ad7538244d63a2159bd686aa000d and project fa76fcc9e30b43e5bc07c834812eb288. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:24:10.719348 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] [instance: 2d1cc2cf-a098-4f96-8e3b-90625fbf9c1e] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:24:10.720979 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:10.721702 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:10.873338 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] [instance: 2d1cc2cf-a098-4f96-8e3b-90625fbf9c1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:24:10.875634 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:10.876340 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:11.239936 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:11.241054 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f53e3e6b-9361-4990-af30-8889697afe63 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:13.811745 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:24:13.896647 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:13.897531 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:14.126956 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:14.127406 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:14.128300 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:14.130177 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:14.161449 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:24:14.166992 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Getting quotas for user bd92f567e5904ced8972590def36011f and project 0cc4fc055b004a6ebfbedb529dda9056. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:24:14.180729 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 638a6344-687f-43cd-8da9-72b161837432] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:24:14.182095 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:14.182697 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:14.341773 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] [instance: 638a6344-687f-43cd-8da9-72b161837432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:24:14.343100 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:14.343539 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:14.804163 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:14.804642 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cbe27798-bee0-4b09-b020-5e765c4eff79 tempest-ServersOnMultiNodesTest-228073668 tempest-ServersOnMultiNodesTest-228073668-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:14.916866 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-22027059-e6c2-4129-8f80-c53f8911b8b5 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:24:14.918477 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-22027059-e6c2-4129-8f80-c53f8911b8b5 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:14.919868 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-22027059-e6c2-4129-8f80-c53f8911b8b5 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:15.991143 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-22027059-e6c2-4129-8f80-c53f8911b8b5 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Created allocations for migration a75d4f83-0dfc-4413-b6bd-8c8d681bc639 on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99477) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:24:16.321703 n-d-791503-3 nova-conductor[99477]: DEBUG nova.scheduler.utils [None req-22027059-e6c2-4129-8f80-c53f8911b8b5 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] [instance: 6bd75c6b-055e-4860-9751-15e7e7e1dfbd] Instance allocations successfully created on destination node 7df066a6-f733-45d1-9e5a-5ab4cb09500f: {'allocations': {'7df066a6-f733-45d1-9e5a-5ab4cb09500f': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99477) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 19 14:24:16.322543 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-22027059-e6c2-4129-8f80-c53f8911b8b5 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lazy-loading 'resources' on Instance uuid 6bd75c6b-055e-4860-9751-15e7e7e1dfbd {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:24:16.331413 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-22027059-e6c2-4129-8f80-c53f8911b8b5 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6bd75c6b-055e-4860-9751-15e7e7e1dfbd {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:24:17.211983 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:24:17.254841 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:17.255563 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:17.256917 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.live_migrate [None req-22027059-e6c2-4129-8f80-c53f8911b8b5 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] [instance: 6bd75c6b-055e-4860-9751-15e7e7e1dfbd] Start binding ports on destination host: n-h1-791503-3 {{(pid=99477) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 19 14:24:17.400608 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:17.400903 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:17.401922 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:17.402417 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:17.421876 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Getting quotas for project eb345679acf5446eb0b4c2d255daf1c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:24:17.427361 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Getting quotas for user cf8d497085c440c1b4b2457e587167b9 and project eb345679acf5446eb0b4c2d255daf1c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:24:17.456471 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] [instance: de2cfd78-baa9-4141-a97c-5984ee199520] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:24:17.456471 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:17.456778 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:17.571466 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] [instance: de2cfd78-baa9-4141-a97c-5984ee199520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:24:17.573481 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:17.574455 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:18.109598 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:18.110838 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-69db4ad4-562b-4005-9cb5-0ad253d08eef tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:31.311209 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:24:31.359579 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:31.360020 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:31.545684 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:31.546009 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:31.546744 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:31.547132 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:31.567439 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Getting quotas for project 3cbc018d1b9a4bc795b35b4a3312693d. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:24:31.581586 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Getting quotas for user 579920d83e2c423fbcf06f86d0585d65 and project 3cbc018d1b9a4bc795b35b4a3312693d. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:24:31.588507 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] [instance: a93ea4ed-ddae-4f66-9dbf-4e974e6a8703] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:24:31.588507 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:31.591260 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:31.695870 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] [instance: a93ea4ed-ddae-4f66-9dbf-4e974e6a8703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:24:31.700469 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:31.701661 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:31.983024 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:31.983508 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a8605b90-0001-4819-89c7-5da4e7b3586e tempest-FloatingIPsAssociationTestJSON-91005086 tempest-FloatingIPsAssociationTestJSON-91005086-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:46.877488 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Took 1.39 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:24:46.912044 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:46.915030 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:47.101211 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:47.106978 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:47.109046 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:47.117398 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:47.185359 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Getting quotas for project 8b3cf153a24c4735b80265a4433af3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:24:47.200141 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Getting quotas for user 65f6365d1f4741f3905c5c8efbb1a533 and project 8b3cf153a24c4735b80265a4433af3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:24:47.251037 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] [instance: c30c6f91-e557-4c22-be8b-37bd7fcc6c81] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:24:47.259295 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:47.263863 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:47.410407 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] [instance: c30c6f91-e557-4c22-be8b-37bd7fcc6c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:24:47.415371 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:47.417523 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:24:47.821176 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:24:47.821964 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8933640f-bf7c-4e12-8e02-09ce235073e6 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:14.723708 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-d0f6ae0b-114b-41d2-8f57-6e330eb23905 tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:25:14.724973 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d0f6ae0b-114b-41d2-8f57-6e330eb23905 tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:14.725681 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d0f6ae0b-114b-41d2-8f57-6e330eb23905 tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:16.006544 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-d0f6ae0b-114b-41d2-8f57-6e330eb23905 tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Created allocations for migration 39a60f4e-cfa7-4ede-9ed8-c378b80d6005 on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99477) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:25:16.383874 n-d-791503-3 nova-conductor[99477]: DEBUG nova.scheduler.utils [None req-d0f6ae0b-114b-41d2-8f57-6e330eb23905 tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] [instance: de2cfd78-baa9-4141-a97c-5984ee199520] Instance allocations successfully created on destination node 1393a5cf-e110-4cb7-bac4-fa53d5684d2a: {'allocations': {'1393a5cf-e110-4cb7-bac4-fa53d5684d2a': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99477) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 19 14:25:16.385293 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-d0f6ae0b-114b-41d2-8f57-6e330eb23905 tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lazy-loading 'resources' on Instance uuid de2cfd78-baa9-4141-a97c-5984ee199520 {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:25:16.391534 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-d0f6ae0b-114b-41d2-8f57-6e330eb23905 tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lazy-loading 'pci_requests' on Instance uuid de2cfd78-baa9-4141-a97c-5984ee199520 {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:25:17.153440 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.live_migrate [None req-d0f6ae0b-114b-41d2-8f57-6e330eb23905 tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] [instance: de2cfd78-baa9-4141-a97c-5984ee199520] Start binding ports on destination host: n-h2-791503-3 {{(pid=99477) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 19 14:25:22.103044 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:25:22.149741 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:22.150147 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:22.343080 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:22.344629 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:22.346114 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:22.347307 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:22.420921 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Getting quotas for project fa76fcc9e30b43e5bc07c834812eb288. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:25:22.439333 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Getting quotas for user 5cf6ad7538244d63a2159bd686aa000d and project fa76fcc9e30b43e5bc07c834812eb288. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:25:22.459964 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] [instance: d9e9d58d-4137-4164-81e8-e5969c6e591c] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:25:22.460973 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:22.461406 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:22.536226 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] [instance: d9e9d58d-4137-4164-81e8-e5969c6e591c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:25:22.538313 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:22.538935 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:23.078464 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:23.082213 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-0ece7464-5b2c-4901-9a64-65372b2e2a15 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:38.121436 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:25:38.219915 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:38.220918 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:38.481045 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:38.482036 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:38.484936 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:38.487573 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:38.521034 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Getting quotas for project 900089301d854c3693ff2e99b849722d. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:25:38.542816 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Getting quotas for user 601900bf0ae447e2969d4d928a96497c and project 900089301d854c3693ff2e99b849722d. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:25:38.583994 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] [instance: bcb03c40-a399-4abc-8ea1-fd52356a0e7f] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:25:38.585213 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:38.585891 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:38.712108 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] [instance: bcb03c40-a399-4abc-8ea1-fd52356a0e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:25:38.714883 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:38.715796 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:38.849600 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:38.850513 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:39.260904 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:39.261720 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98749477-33bd-45a3-b96b-ec590a402580 tempest-ServersWithSpecificFlavorTestJSON-1833199297 tempest-ServersWithSpecificFlavorTestJSON-1833199297-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:53.478960 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7ebf37f4-9824-407c-b3ce-d9355f109368 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:25:53.480108 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7ebf37f4-9824-407c-b3ce-d9355f109368 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:25:53.480792 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7ebf37f4-9824-407c-b3ce-d9355f109368 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:25:55.092715 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-7ebf37f4-9824-407c-b3ce-d9355f109368 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Created allocations for migration 0963e234-1af2-4915-8184-f2775137453a on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:25:55.492712 n-d-791503-3 nova-conductor[99476]: DEBUG nova.scheduler.utils [None req-7ebf37f4-9824-407c-b3ce-d9355f109368 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] [instance: c30c6f91-e557-4c22-be8b-37bd7fcc6c81] Instance allocations successfully created on destination node 7df066a6-f733-45d1-9e5a-5ab4cb09500f: {'allocations': {'7df066a6-f733-45d1-9e5a-5ab4cb09500f': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99476) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 19 14:25:55.493143 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-7ebf37f4-9824-407c-b3ce-d9355f109368 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lazy-loading 'resources' on Instance uuid c30c6f91-e557-4c22-be8b-37bd7fcc6c81 {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:25:55.499752 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-7ebf37f4-9824-407c-b3ce-d9355f109368 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lazy-loading 'pci_requests' on Instance uuid c30c6f91-e557-4c22-be8b-37bd7fcc6c81 {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:25:56.400886 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.live_migrate [None req-7ebf37f4-9824-407c-b3ce-d9355f109368 tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] [instance: c30c6f91-e557-4c22-be8b-37bd7fcc6c81] Start binding ports on destination host: n-h1-791503-3 {{(pid=99476) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 19 14:26:01.865749 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Took 1.15 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:26:01.917159 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:01.917771 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:02.145861 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:02.147045 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:02.151302 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:02.153214 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:02.190477 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Getting quotas for project 5df05b679471448c899c21c4e3915051. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:26:02.206989 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Getting quotas for user 7e8810dfc6e14067a59221dfc29ad40f and project 5df05b679471448c899c21c4e3915051. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:26:02.248997 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] [instance: a4d1d122-a8b7-4b28-b28f-748a928d748c] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:26:02.251357 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:02.252017 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:02.332781 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] [instance: a4d1d122-a8b7-4b28-b28f-748a928d748c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:26:02.334521 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:02.335833 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:02.786731 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:02.787155 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-923ac30d-9feb-4954-927b-ff8d8d6eae67 tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:29.500806 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:26:29.554652 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:29.557694 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:29.915363 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:29.915762 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:29.916499 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:29.916895 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:29.964583 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Getting quotas for project e4a6ed88ddd84dd996fac72cac3c86d3. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:26:29.970621 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Getting quotas for user 72772d97c8fa42df926945ecaba14117 and project e4a6ed88ddd84dd996fac72cac3c86d3. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:26:29.991949 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] [instance: 40b16b9f-08b0-49fa-b505-644c91476abd] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:26:29.993316 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:29.993919 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:30.077304 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] [instance: 40b16b9f-08b0-49fa-b505-644c91476abd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:26:30.079585 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:30.080159 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:30.483096 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:30.483784 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-80bd44ad-6ea3-469d-af8e-31910d310a80 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430 tempest-FloatingIPsAssociationNegativeTestJSON-1711354430-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:34.894507 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:26:34.977945 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:34.980482 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:35.443024 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:35.443431 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:35.444444 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:35.444565 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:35.487552 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Getting quotas for project 4473c334d9a64e27ace86ac39a07fbc9. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:26:35.512693 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Getting quotas for user 32ddcd1da2e54f75bbf69db7d0cf7be3 and project 4473c334d9a64e27ace86ac39a07fbc9. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:26:35.537596 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] [instance: 5a86955f-dea0-44b6-b759-fc7d34d7bd42] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:26:35.539351 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:35.547985 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:35.671031 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] [instance: 5a86955f-dea0-44b6-b759-fc7d34d7bd42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:26:35.681480 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:35.681480 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:36.045449 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:36.046374 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a3edcd5c-8c8c-4af0-a846-b945b2786d84 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:39.986168 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:26:40.034361 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:40.034771 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:40.259723 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:40.264929 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:40.264929 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:40.265389 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:40.308784 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Getting quotas for project 5df05b679471448c899c21c4e3915051. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:26:40.316537 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Getting quotas for user 7e8810dfc6e14067a59221dfc29ad40f and project 5df05b679471448c899c21c4e3915051. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:26:40.333959 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] [instance: ea37fa4c-2322-4a11-adbd-39791d9d10de] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:26:40.335898 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:40.337224 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:40.468576 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] [instance: ea37fa4c-2322-4a11-adbd-39791d9d10de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:26:40.470470 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:40.471094 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:26:41.190571 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:26:41.190571 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16a09e7c-2b84-4226-9f7c-5edf3f11abcc tempest-LiveMigrationNegativeTest-1136872884 tempest-LiveMigrationNegativeTest-1136872884-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:10.318061 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:27:10.385569 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:10.386276 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:10.568382 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:10.573107 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:10.577925 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:10.578451 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:10.653177 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Getting quotas for project eb345679acf5446eb0b4c2d255daf1c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:27:10.680396 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Getting quotas for user cf8d497085c440c1b4b2457e587167b9 and project eb345679acf5446eb0b4c2d255daf1c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:27:10.718397 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] [instance: 014d8d7f-cad3-494a-b7b2-bb396f6b7a4d] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:27:10.721838 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:10.722541 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:10.811101 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] [instance: 014d8d7f-cad3-494a-b7b2-bb396f6b7a4d] block_device_mapping [BlockDeviceMapping(attachment_id=0018554f-4a5b-4479-9f1b-de8adcdca775,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9fda5ae6-4cf6-4541-a7d7-935cc741ed69',volume_size=1,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:27:10.813248 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:10.818468 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:11.264854 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:11.265547 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-aee2a3f6-8dc0-4c21-81ef-4611ca7dd20e tempest-LiveMigrationTest-150796926 tempest-LiveMigrationTest-150796926-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:21.722849 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:27:21.778422 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:21.780595 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:22.057151 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:22.057492 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:22.059039 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:22.059642 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:22.118973 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Getting quotas for project fa76fcc9e30b43e5bc07c834812eb288. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:27:22.138433 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Getting quotas for user 5cf6ad7538244d63a2159bd686aa000d and project fa76fcc9e30b43e5bc07c834812eb288. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:27:22.157252 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] [instance: 7f6a2d27-8424-4a4d-a9a5-1a2701707cc1] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:27:22.158501 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:22.159056 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:22.232834 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] [instance: 7f6a2d27-8424-4a4d-a9a5-1a2701707cc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:27:22.234554 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:22.234947 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:22.811084 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:22.812314 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2ce56344-399a-40e6-865c-485c0eb39523 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:41.561406 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:27:41.622466 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:41.622886 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:41.883043 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:41.883988 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:41.885478 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:41.886257 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:41.934064 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Getting quotas for project 8b3cf153a24c4735b80265a4433af3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:27:41.951316 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Getting quotas for user 65f6365d1f4741f3905c5c8efbb1a533 and project 8b3cf153a24c4735b80265a4433af3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:27:42.003669 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] [instance: 7b219ca8-6441-49c6-814c-8c775e9fe0c0] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:27:42.012408 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:42.017018 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:42.193054 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] [instance: 7b219ca8-6441-49c6-814c-8c775e9fe0c0] block_device_mapping [BlockDeviceMapping(attachment_id=59f17797-f5ad-40a3-9ed6-961a77dd86cb,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2cd8cfc-627d-4c45-8e7c-e673fa1d5ae8',volume_size=1,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:27:42.197432 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:42.198843 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:42.563215 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:42.565902 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a014129e-2154-48fe-bdb5-ed9f178bbe55 tempest-LiveAutoBlockMigrationV225Test-105798215 tempest-LiveAutoBlockMigrationV225Test-105798215-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:45.933576 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-a44cda3c-4ad1-406a-8c59-d1ffe30a5a3e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:27:45.939203 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-a44cda3c-4ad1-406a-8c59-d1ffe30a5a3e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:27:45.941979 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-a44cda3c-4ad1-406a-8c59-d1ffe30a5a3e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:27:47.212221 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-a44cda3c-4ad1-406a-8c59-d1ffe30a5a3e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Created allocations for migration 8e795836-1320-4d58-98c3-bc12886f4b17 on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:27:47.809539 n-d-791503-3 nova-conductor[99476]: DEBUG nova.scheduler.utils [None req-a44cda3c-4ad1-406a-8c59-d1ffe30a5a3e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] [instance: 014d8d7f-cad3-494a-b7b2-bb396f6b7a4d] Instance allocations successfully created on destination node 7df066a6-f733-45d1-9e5a-5ab4cb09500f: {'allocations': {'7df066a6-f733-45d1-9e5a-5ab4cb09500f': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=99476) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 19 14:27:47.810655 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-a44cda3c-4ad1-406a-8c59-d1ffe30a5a3e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lazy-loading 'resources' on Instance uuid 014d8d7f-cad3-494a-b7b2-bb396f6b7a4d {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:27:47.824325 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-a44cda3c-4ad1-406a-8c59-d1ffe30a5a3e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] Lazy-loading 'pci_requests' on Instance uuid 014d8d7f-cad3-494a-b7b2-bb396f6b7a4d {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:27:48.781558 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.live_migrate [None req-a44cda3c-4ad1-406a-8c59-d1ffe30a5a3e tempest-LiveMigrationTest-1317698487 tempest-LiveMigrationTest-1317698487-project-admin] [instance: 014d8d7f-cad3-494a-b7b2-bb396f6b7a4d] Start binding ports on destination host: n-h1-791503-3 {{(pid=99476) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 19 14:28:12.045239 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:28:12.137498 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:12.139392 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:12.422864 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:12.431138 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:12.433544 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:12.434197 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:12.476295 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Getting quotas for project 4473c334d9a64e27ace86ac39a07fbc9. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:28:12.484161 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Getting quotas for user 32ddcd1da2e54f75bbf69db7d0cf7be3 and project 4473c334d9a64e27ace86ac39a07fbc9. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:28:12.508976 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] [instance: e83fefb0-29ef-4fc3-87f5-ad5406bd1a07] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:28:12.512863 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:12.516396 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:12.660392 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] [instance: e83fefb0-29ef-4fc3-87f5-ad5406bd1a07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:28:12.664043 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:12.664678 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:13.101320 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:13.102709 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6dc9bebc-734f-43a1-bfc7-70d02ac46f56 tempest-ServersTestMultiNic-201922060 tempest-ServersTestMultiNic-201922060-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:16.395615 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:28:17.423522 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47594. May 19 14:28:17.619411 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6a72c4fd-00dc-43f1-b2ff-125f98ade8ec tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:28:17.621466 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6a72c4fd-00dc-43f1-b2ff-125f98ade8ec tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:17.622724 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6a72c4fd-00dc-43f1-b2ff-125f98ade8ec tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:18.936502 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-6a72c4fd-00dc-43f1-b2ff-125f98ade8ec tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Created allocations for migration b677036d-4c4f-4ab5-83b2-84f3b6f70e73 on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:28:19.542578 n-d-791503-3 nova-conductor[99476]: DEBUG nova.scheduler.utils [None req-6a72c4fd-00dc-43f1-b2ff-125f98ade8ec tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] [instance: 7b219ca8-6441-49c6-814c-8c775e9fe0c0] Instance allocations successfully created on destination node 7df066a6-f733-45d1-9e5a-5ab4cb09500f: {'allocations': {'7df066a6-f733-45d1-9e5a-5ab4cb09500f': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=99476) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} May 19 14:28:19.543017 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-6a72c4fd-00dc-43f1-b2ff-125f98ade8ec tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lazy-loading 'resources' on Instance uuid 7b219ca8-6441-49c6-814c-8c775e9fe0c0 {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:28:19.550151 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-6a72c4fd-00dc-43f1-b2ff-125f98ade8ec tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] Lazy-loading 'pci_requests' on Instance uuid 7b219ca8-6441-49c6-814c-8c775e9fe0c0 {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:28:20.681011 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.live_migrate [None req-6a72c4fd-00dc-43f1-b2ff-125f98ade8ec tempest-LiveAutoBlockMigrationV225Test-1859687901 tempest-LiveAutoBlockMigrationV225Test-1859687901-project-admin] [instance: 7b219ca8-6441-49c6-814c-8c775e9fe0c0] Start binding ports on destination host: n-h1-791503-3 {{(pid=99476) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 19 14:28:28.218920 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Took 1.42 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:28:28.274683 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:28.276465 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:28.807420 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:28.808307 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:28.809295 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:28.809882 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:28.837015 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Getting quotas for project 9caada3fb9094665ba2997231b2d5574. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:28:28.849962 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Getting quotas for user 9fce2031dc8a40b9ae13ac1bd610c65b and project 9caada3fb9094665ba2997231b2d5574. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:28:28.880912 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] [instance: f287c877-4115-4d15-a53d-fa52ac72e448] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:28:28.881876 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:28.882270 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:29.087477 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] [instance: f287c877-4115-4d15-a53d-fa52ac72e448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:28:29.090814 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:29.090814 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:29.573775 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:29.574420 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a99e80f0-8261-4910-a261-46fb0b2e5d76 tempest-ServerDiagnosticsNegativeTest-233106061 tempest-ServerDiagnosticsNegativeTest-233106061-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:33.626221 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:28:33.666267 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:33.666683 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:33.926394 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:33.927101 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:33.928039 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:33.928617 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:33.973873 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Getting quotas for project fa76fcc9e30b43e5bc07c834812eb288. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:28:33.979373 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Getting quotas for user 5cf6ad7538244d63a2159bd686aa000d and project fa76fcc9e30b43e5bc07c834812eb288. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:28:34.007642 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] [instance: 1cb04ece-e5b2-475c-81c2-c1e59e9eb929] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:28:34.008607 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:34.009011 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:34.196009 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] [instance: 1cb04ece-e5b2-475c-81c2-c1e59e9eb929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:28:34.197359 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:34.197781 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:28:34.894210 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:28:34.898592 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5a9b1d79-d0b0-4339-8218-eb8bd80682f5 tempest-ImagesTestJSON-1739804537 tempest-ImagesTestJSON-1739804537-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:30.798414 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:29:30.862991 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:30.863435 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:31.280709 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:31.281306 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:31.282200 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:31.282632 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:31.300151 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Getting quotas for project 98a99abac1084357af312a0a8b55ce6f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:29:31.305819 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Getting quotas for user 7303f428e1224b0a9ecb08749f26c883 and project 98a99abac1084357af312a0a8b55ce6f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:29:31.319194 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] [instance: 55f73288-92f8-4db4-9478-e9e69739860b] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:29:31.320176 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:31.320584 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:31.395903 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] [instance: 55f73288-92f8-4db4-9478-e9e69739860b] block_device_mapping [BlockDeviceMapping(attachment_id=7087533f-1f76-49c8-ba64-0ee0c2b5f8fc,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a57cbf7e-bb01-42b0-8b33-f8a9d93ea9e5',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=0c825189-2d47-437a-8ed3-8649e581818d,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3b588e8f-e847-4c49-9750-2ab868b76248',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=cb3050e2-de0f-4bc1-b930-44be29362f85,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92ddf728-2781-4454-932d-1fa9c33c3d0e',volume_size=1,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:29:31.397669 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:31.398278 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:31.522846 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:31.523542 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:31.624274 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:31.624679 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:31.966528 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:31.967741 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b2d1f42c-bb97-4ecf-b48d-464b55f7e304 tempest-TaggedBootDevicesTest_v242-216327565 tempest-TaggedBootDevicesTest_v242-216327565-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:46.977639 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:29:47.073363 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:47.074368 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:47.517092 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:47.520022 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:47.522630 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:47.525418 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:47.603672 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Getting quotas for project 25cf3020953445c6828624754ed85493. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:29:47.620236 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Getting quotas for user d7ae690ad68242a489d132ae10948026 and project 25cf3020953445c6828624754ed85493. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:29:47.672922 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] [instance: f006323f-91b6-4a01-8a10-47b8bc58b3ab] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:29:47.674588 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:47.678459 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:47.823848 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] [instance: f006323f-91b6-4a01-8a10-47b8bc58b3ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:29:47.827337 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:47.827337 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:29:48.212235 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:29:48.212235 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-35150b79-96ab-4b88-b7c7-991658de203e tempest-InstanceActionsV221TestJSON-1780061148 tempest-InstanceActionsV221TestJSON-1780061148-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:16.022740 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:30:16.050160 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:16.050571 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:16.289584 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:16.290004 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:16.290883 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:16.291407 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:16.319123 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Getting quotas for project b972735579fc4a84914c0e8e455b67fa. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:30:16.325542 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Getting quotas for user a33b9dbbe5d443008811f52f09ac1e75 and project b972735579fc4a84914c0e8e455b67fa. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:30:16.341977 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] [instance: 810eccb0-fc68-4c8e-b1b3-1e3b82ee4069] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:30:16.343414 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:16.343966 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:16.453120 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] [instance: 810eccb0-fc68-4c8e-b1b3-1e3b82ee4069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:30:16.454755 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:16.457240 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:16.846446 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:16.847009 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-74a91a9a-d158-42e4-b4df-9abc1e822957 tempest-ServersTestManualDisk-31833063 tempest-ServersTestManualDisk-31833063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:18.173489 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:30:18.206308 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:18.206833 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:18.479709 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:18.482499 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:18.483528 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:18.484161 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:18.525993 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Getting quotas for project 8b318c9d870e487d8b5db68bfab41daa. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:30:18.537699 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Getting quotas for user 547ca97fc23440cf98b22db6300819eb and project 8b318c9d870e487d8b5db68bfab41daa. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:30:18.573486 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] [instance: d17f934f-649a-43c6-b598-71f253d26705] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:30:18.574957 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:18.575932 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:18.737921 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] [instance: d17f934f-649a-43c6-b598-71f253d26705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:30:18.739088 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:18.739533 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:19.183401 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:19.195810 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef3564c1-9e80-40fa-a8b1-6308dc013ebb tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:19.996634 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:30:20.035844 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:20.036521 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:20.384245 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:20.384748 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:20.385599 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:20.386092 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:20.412082 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Getting quotas for project 932326a9936a4f1e80bbe77d73adb5b6. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:30:20.421630 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Getting quotas for user aac30faf7b224c7f8116255758372805 and project 932326a9936a4f1e80bbe77d73adb5b6. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:30:20.447666 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:30:20.454612 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: 739c50e5-160a-4c1d-b700-050463c04bca] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:30:20.454612 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:20.454612 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:20.480498 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:20.480912 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:20.594720 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: 739c50e5-160a-4c1d-b700-050463c04bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:30:20.595978 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:20.596272 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:20.877090 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:20.877541 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:20.878399 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:20.878973 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:20.896969 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Getting quotas for project 9dfa38ba51ea4290beb2eb00565de349. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:30:20.902313 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Getting quotas for user fb1da53630b845af8a995b8917732493 and project 9dfa38ba51ea4290beb2eb00565de349. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:30:20.916466 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] [instance: d79600f7-a0df-4d25-b4dd-106d77d64571] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:30:20.917507 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:20.917915 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:21.087377 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] [instance: d79600f7-a0df-4d25-b4dd-106d77d64571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:30:21.088290 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:21.088764 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:21.093700 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:21.094970 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-04edfa4b-9a2f-4559-9c3e-0b28822ac891 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:21.509450 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:21.510557 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b0652ae9-39f6-463b-a8ba-c0fc743613b5 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:23.808909 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:30:23.840041 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:23.840560 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:24.109874 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:24.109874 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:24.110105 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:24.110379 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:24.130799 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Getting quotas for project 9dfa38ba51ea4290beb2eb00565de349. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:30:24.136347 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Getting quotas for user fb1da53630b845af8a995b8917732493 and project 9dfa38ba51ea4290beb2eb00565de349. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:30:24.148930 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] [instance: 05084e29-598f-4044-8378-6bc1c9037c7a] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:30:24.150191 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:24.150600 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:24.355632 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] [instance: 05084e29-598f-4044-8378-6bc1c9037c7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:30:24.357615 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:24.358415 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:24.714324 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:24.719592 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-62c6abfd-8a69-43a3-b43e-d00aef55a456 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:49.003101 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:30:49.660831 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-28a62e76-12e5-4b34-9aae-de8faa750af7 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:30:49.661540 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-28a62e76-12e5-4b34-9aae-de8faa750af7 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:49.669838 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-28a62e76-12e5-4b34-9aae-de8faa750af7 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:50.025371 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50116. May 19 14:30:51.567796 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-28a62e76-12e5-4b34-9aae-de8faa750af7 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] [instance: 739c50e5-160a-4c1d-b700-050463c04bca] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99476) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 14:30:52.672781 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-28a62e76-12e5-4b34-9aae-de8faa750af7 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] Created allocations for migration 6b8e608c-c6ec-4054-bee7-ba59cadbd5ff on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:30:53.573821 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-28a62e76-12e5-4b34-9aae-de8faa750af7 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] [instance: 739c50e5-160a-4c1d-b700-050463c04bca] Calling prep_resize with selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99476) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 14:30:58.415976 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:30:58.464551 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:58.464964 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:58.646331 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:58.647240 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:58.648647 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:58.649372 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:58.740610 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Getting quotas for project 9dfa38ba51ea4290beb2eb00565de349. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:30:58.755466 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Getting quotas for user fb1da53630b845af8a995b8917732493 and project 9dfa38ba51ea4290beb2eb00565de349. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:30:58.770568 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] [instance: 8e1cd45b-4175-4d31-a39d-24a08af1e143] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:30:58.771733 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:58.772133 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:58.919134 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] [instance: 8e1cd45b-4175-4d31-a39d-24a08af1e143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:30:58.922282 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:58.923623 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:30:59.343172 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:30:59.343574 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7513fced-e4fb-4362-85b6-04d21b4b92a0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:14.832766 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:31:14.911559 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:14.912059 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:15.196203 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:15.198168 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:15.199385 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:15.200946 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:15.228014 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:31:15.235494 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for user 68c80c83fbaf44e1b9654922391b2fa7 and project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:31:15.270544 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: ec665a2b-61ce-474f-9edf-c1b956901cd6] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:31:15.272429 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:15.272703 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:15.388376 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: ec665a2b-61ce-474f-9edf-c1b956901cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:31:15.390056 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:15.390698 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:15.874000 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:15.874593 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7049c263-2717-4e00-bf96-66c881eb26a2 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:17.420470 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:31:18.444174 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50588. May 19 14:31:19.916834 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:31:19.973795 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:19.974559 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:20.246126 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:20.253760 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:20.255304 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:20.258588 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:20.380631 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Getting quotas for project 8b318c9d870e487d8b5db68bfab41daa. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:31:20.409731 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Getting quotas for user 547ca97fc23440cf98b22db6300819eb and project 8b318c9d870e487d8b5db68bfab41daa. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:31:20.480590 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] [instance: d8c7cbcf-7a45-4bbb-b95d-f3e7011146a3] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:31:20.492099 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:20.498643 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:20.576774 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] [instance: d8c7cbcf-7a45-4bbb-b95d-f3e7011146a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:31:20.579014 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:20.579585 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:20.986709 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:20.987536 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9c284f52-e480-4020-8a01-52a2fb82f582 tempest-SecurityGroupsTestJSON-1791854341 tempest-SecurityGroupsTestJSON-1791854341-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:35.587257 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-943fc6b1-d8d5-4fa5-a52d-710271875e81 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method rebuild_instance {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:31:35.587960 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-943fc6b1-d8d5-4fa5-a52d-710271875e81 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:35.589166 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-943fc6b1-d8d5-4fa5-a52d-710271875e81 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:35.721086 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-943fc6b1-d8d5-4fa5-a52d-710271875e81 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] [instance: d79600f7-a0df-4d25-b4dd-106d77d64571] No migration record for the rebuild/evacuate request. {{(pid=99476) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 19 14:31:36.496526 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:31:36.523137 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:36.523864 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:36.743448 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:36.744317 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:36.745023 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:36.745468 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:36.784679 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Getting quotas for project 932326a9936a4f1e80bbe77d73adb5b6. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:31:36.802179 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Getting quotas for user aac30faf7b224c7f8116255758372805 and project 932326a9936a4f1e80bbe77d73adb5b6. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:31:36.819187 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: b11eca4d-3cc5-4bf2-8f11-14ac01469419] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:31:36.820243 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:36.820847 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:36.947109 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: b11eca4d-3cc5-4bf2-8f11-14ac01469419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:31:36.948456 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:36.948868 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:37.298652 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:37.299059 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ebb09942-62de-40f6-84d5-2693469449cf tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:59.357913 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Took 1.39 seconds to select destinations for 3 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:31:59.382112 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:59.382522 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:59.714267 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:59.714973 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:31:59.962839 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:31:59.962839 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:00.236889 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:00.237866 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:00.242172 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:00.242941 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:00.276619 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Getting quotas for project 5add554064694afb89da19f6433c912a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:32:00.280463 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Getting quotas for user 94df46663ae640a198f20b0317d8a39c and project 5add554064694afb89da19f6433c912a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:32:00.294045 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] [instance: 01979c19-ca19-4346-8565-eb271c6b58ad] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:32:00.295299 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:00.295704 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:00.525927 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] [instance: 01979c19-ca19-4346-8565-eb271c6b58ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:32:00.527038 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:00.527444 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:00.651139 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-8f0a5d26-a311-4341-b830-ed5101eb967b tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:32:00.651642 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8f0a5d26-a311-4341-b830-ed5101eb967b tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:00.652065 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8f0a5d26-a311-4341-b830-ed5101eb967b tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:00.891341 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:00.891833 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:00.902478 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] [instance: 85f4da18-d10e-43c9-8b49-5204e87d0b27] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:32:00.904453 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:00.905015 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:01.034255 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] [instance: 85f4da18-d10e-43c9-8b49-5204e87d0b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:32:01.041352 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:01.041352 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:01.108347 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-8f0a5d26-a311-4341-b830-ed5101eb967b tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: b11eca4d-3cc5-4bf2-8f11-14ac01469419] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99477) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 14:32:01.397655 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:01.398348 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:01.421668 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] [instance: 22998565-fc7e-4c3f-8a60-8b77801c7e05] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:32:01.429012 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:01.429012 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:01.545284 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] [instance: 22998565-fc7e-4c3f-8a60-8b77801c7e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:32:01.548186 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:01.548774 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:02.073880 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:02.074644 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-485ae6c4-2356-4b40-885a-7e927f598bd3 tempest-ListServersNegativeTestJSON-1924547758 tempest-ListServersNegativeTestJSON-1924547758-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:02.076511 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-8f0a5d26-a311-4341-b830-ed5101eb967b tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Created allocations for migration ab5d6d75-ccf8-41bd-9d5e-78a1fd5ca8b1 on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99477) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:32:02.336085 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-955ea73c-b885-4258-8a78-5e2ac56244d0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method rebuild_instance {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:32:02.343567 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-955ea73c-b885-4258-8a78-5e2ac56244d0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:02.343567 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-955ea73c-b885-4258-8a78-5e2ac56244d0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:02.448744 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-955ea73c-b885-4258-8a78-5e2ac56244d0 tempest-ServersAdminTestJSON-2141415388 tempest-ServersAdminTestJSON-2141415388-project] [instance: d79600f7-a0df-4d25-b4dd-106d77d64571] No migration record for the rebuild/evacuate request. {{(pid=99476) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 19 14:32:02.552911 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-8f0a5d26-a311-4341-b830-ed5101eb967b tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: b11eca4d-3cc5-4bf2-8f11-14ac01469419] Calling prep_resize with selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"1393a5cf-e110-4cb7-bac4-fa53d5684d2a": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1393a5cf-e110-4cb7-bac4-fa53d5684d2a"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=1393a5cf-e110-4cb7-bac4-fa53d5684d2a,limits=SchedulerLimits,nodename='n-h2-791503-3',service_host='n-h2-791503-3')] {{(pid=99477) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 14:32:29.615437 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Took 1.26 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:32:29.643156 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:29.643847 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:29.996496 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:29.997251 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:30.004383 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:30.005009 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:30.062901 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:32:30.077031 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for user 5c30efe732914d2db9cf6a6f8c5c8d9a and project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:32:30.106916 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: 26820a25-1e9b-41b6-b563-f74cf52d4967] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:32:30.109125 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:30.111044 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:30.321944 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: 26820a25-1e9b-41b6-b563-f74cf52d4967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:32:30.324608 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:30.325051 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:30.899644 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:30.899644 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f0c4542e-e81b-49d0-af29-28e8f814dbb2 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:37.898040 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:32:37.960403 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:37.960794 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:38.281788 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:38.282330 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:38.283349 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:38.283770 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:38.301982 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Getting quotas for project 61c7e418f9e24d81a34b30a8849830a1. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:32:38.308170 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Getting quotas for user 879e27495ec940ffbea76df363ffbcdd and project 61c7e418f9e24d81a34b30a8849830a1. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:32:38.321244 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] [instance: a5692b47-1da2-4a87-ad88-68200dede5ab] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:32:38.324056 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:38.324490 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:38.420130 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] [instance: a5692b47-1da2-4a87-ad88-68200dede5ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:32:38.421848 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:38.422346 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:38.780128 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:38.780921 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ef905d9f-7d0b-410b-b039-033bd473acef tempest-ServersTestJSON-2078267961 tempest-ServersTestJSON-2078267961-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:56.735315 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Took 1.11 seconds to select destinations for 2 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:32:56.777043 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:56.781258 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:57.115962 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:57.116826 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:57.301100 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:57.302079 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:57.303426 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:57.304617 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:57.335609 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Getting quotas for project 10ea6d5f2f004c6c9cf17dcc3a647c05. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:32:57.345750 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Getting quotas for user 27b9ab0e89424b83b8cda0a54c90ab88 and project 10ea6d5f2f004c6c9cf17dcc3a647c05. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:32:57.365792 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] [instance: 0ab41c39-96ea-4d0a-9082-b7973222b52f] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:32:57.367422 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:57.368316 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:57.436909 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] [instance: 0ab41c39-96ea-4d0a-9082-b7973222b52f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:32:57.438745 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:57.439896 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:57.780471 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:57.781090 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:57.817124 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] [instance: e718dfbd-60c7-41af-8280-330956eb2d71] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:32:57.818783 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:57.819419 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:58.002320 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] [instance: e718dfbd-60c7-41af-8280-330956eb2d71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:32:58.005823 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:58.007057 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:58.408139 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:58.408630 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4acf7671-3b2f-4a96-9b60-0ef230192433 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:58.724285 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:32:58.829867 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:58.830073 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:59.026054 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:59.026692 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:59.027859 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:59.028476 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:59.095363 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Getting quotas for project 932326a9936a4f1e80bbe77d73adb5b6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:32:59.106172 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Getting quotas for user aac30faf7b224c7f8116255758372805 and project 932326a9936a4f1e80bbe77d73adb5b6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:32:59.129314 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: 7275c73c-2c8b-4000-a2a9-a70ff4d90959] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:32:59.130782 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:59.131429 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:59.223531 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: 7275c73c-2c8b-4000-a2a9-a70ff4d90959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:32:59.227132 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:59.228433 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:32:59.550774 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:32:59.551685 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-61ca70cd-43ba-4aec-a5fb-a6d9fc2b7fb2 tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:03.799902 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:33:03.839402 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:03.840180 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:04.075943 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:04.077171 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:04.083522 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:04.083522 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:04.146716 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:33:04.165236 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for user 5c30efe732914d2db9cf6a6f8c5c8d9a and project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:33:04.224444 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: 84bea3e1-02c8-4bd7-9dcb-b5aece777535] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:33:04.235486 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:04.238658 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:04.357663 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: 84bea3e1-02c8-4bd7-9dcb-b5aece777535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:33:04.361051 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:04.362226 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:04.694626 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:04.696149 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a314dc1b-c6ec-4391-a56a-ca84b9f321f0 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:24.644301 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f5ffb737-d958-4d5c-98cf-864b70cf52bd tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:33:24.644870 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5ffb737-d958-4d5c-98cf-864b70cf52bd tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:24.645237 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5ffb737-d958-4d5c-98cf-864b70cf52bd tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:24.996086 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-f5ffb737-d958-4d5c-98cf-864b70cf52bd tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: 7275c73c-2c8b-4000-a2a9-a70ff4d90959] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99476) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 14:33:25.901130 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-f5ffb737-d958-4d5c-98cf-864b70cf52bd tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Created allocations for migration eae0022a-fb37-46af-a8a7-90afc9c2a182 on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:33:26.476957 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-f5ffb737-d958-4d5c-98cf-864b70cf52bd tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: 7275c73c-2c8b-4000-a2a9-a70ff4d90959] Calling prep_resize with selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"7df066a6-f733-45d1-9e5a-5ab4cb09500f": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7df066a6-f733-45d1-9e5a-5ab4cb09500f"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=7df066a6-f733-45d1-9e5a-5ab4cb09500f,limits=SchedulerLimits,nodename='n-h1-791503-3',service_host='n-h1-791503-3')] {{(pid=99476) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 14:33:29.379755 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Took 0.78 seconds to select destinations for 2 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:33:29.448346 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:29.448760 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:29.655025 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:29.656487 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:29.777361 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:29.777774 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:29.778511 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:29.778906 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:29.796889 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Getting quotas for project 10ea6d5f2f004c6c9cf17dcc3a647c05. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:33:29.802394 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Getting quotas for user 27b9ab0e89424b83b8cda0a54c90ab88 and project 10ea6d5f2f004c6c9cf17dcc3a647c05. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:33:29.815020 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] [instance: fa29cc40-e433-4dc0-bfda-6f66e8cff9e1] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:33:29.816004 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:29.816400 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:29.966314 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] [instance: fa29cc40-e433-4dc0-bfda-6f66e8cff9e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:33:29.967713 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:29.968120 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:30.384758 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:30.385508 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:30.404068 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] [instance: bec2d008-35fa-483d-bd8a-5dbe4283e64e] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:33:30.405302 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:30.406076 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:30.478323 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] [instance: bec2d008-35fa-483d-bd8a-5dbe4283e64e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:33:30.480230 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:30.480646 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:30.842124 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:33:30.844019 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-a018e184-1497-4884-9cdd-00d6099b5705 tempest-MultipleCreateTestJSON-1872764821 tempest-MultipleCreateTestJSON-1872764821-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:33:50.026811 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:33:51.063154 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53318. May 19 14:34:02.664627 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-1285a7be-8b9f-40f2-8fcf-c745b78660e9 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:34:02.747819 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-1285a7be-8b9f-40f2-8fcf-c745b78660e9 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: a4dd7726-9bab-4806-8bc7-e225a060fb08] While scheduling instance, the build request was already deleted. {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1572}} May 19 14:34:03.550306 n-d-791503-3 nova-conductor[99476]: WARNING nova.scheduler.client.report [None req-1285a7be-8b9f-40f2-8fcf-c745b78660e9 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Unable to delete allocation for instance a4dd7726-9bab-4806-8bc7-e225a060fb08: (409 {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Inventory and/or allocations changed while attempting to allocate: Another thread concurrently updated the data. Please retry your update ", "code": "placement.concurrent_update", "request_id": "req-892ed087-395d-4423-a187-16e2f1175074"}]}): nova.exception.BuildRequestNotFound: BuildRequest not found for instance a4dd7726-9bab-4806-8bc7-e225a060fb08 May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server [None req-1285a7be-8b9f-40f2-8fcf-c745b78660e9 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Exception during message handling: nova.exception.AllocationDeleteFailed: Failed to delete allocations for consumer a4dd7726-9bab-4806-8bc7-e225a060fb08. Error: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Inventory and/or allocations changed while attempting to allocate: Another thread concurrently updated the data. Please retry your update ", "code": "placement.concurrent_update", "request_id": "req-892ed087-395d-4423-a187-16e2f1175074"}]} May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 1568, in schedule_and_build_instances May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server objects.BuildRequest.get_by_instance_uuid( May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server result = fn(cls, context, *args, **kwargs) May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/objects/build_request.py", line 176, in get_by_instance_uuid May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/objects/build_request.py", line 171, in _get_by_instance_uuid_from_db May 19 14:34:03.565225 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server raise exception.BuildRequestNotFound(uuid=instance_uuid) May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server nova.exception.BuildRequestNotFound: BuildRequest not found for instance a4dd7726-9bab-4806-8bc7-e225a060fb08 May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 1585, in schedule_and_build_instances May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server self.report_client.delete_allocation_for_instance( May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/scheduler/client/report.py", line 73, in wrapper May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server return f(self, *a, **k) May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/scheduler/client/report.py", line 2121, in delete_allocation_for_instance May 19 14:34:03.567365 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server raise exception.AllocationDeleteFailed(consumer_uuid=uuid, May 19 14:34:03.570117 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server nova.exception.AllocationDeleteFailed: Failed to delete allocations for consumer a4dd7726-9bab-4806-8bc7-e225a060fb08. Error: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Inventory and/or allocations changed while attempting to allocate: Another thread concurrently updated the data. Please retry your update ", "code": "placement.concurrent_update", "request_id": "req-892ed087-395d-4423-a187-16e2f1175074"}]} May 19 14:34:03.570117 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server May 19 14:34:07.104564 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:34:07.159479 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:07.164386 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:07.367424 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:07.371305 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:07.371305 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:07.371305 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:07.463374 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:34:07.492031 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for user 5c30efe732914d2db9cf6a6f8c5c8d9a and project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:34:07.550110 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: d0e19e4d-f905-4631-a1f8-01bc7a5a04b0] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:34:07.555977 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:07.557458 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:07.718316 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: d0e19e4d-f905-4631-a1f8-01bc7a5a04b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:34:07.720247 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:07.720899 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:08.209932 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:08.210986 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-7fef909f-e1ac-404b-8116-9d5ed0c52c1e tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:18.446314 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:34:19.498510 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53848. May 19 14:34:30.574496 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:34:30.626524 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:30.627263 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:31.158025 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:31.159506 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:31.160778 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:31.161615 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:31.184411 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Getting quotas for project b4ef3d17aa174b00ade5f3a060dd691a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:34:31.191050 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Getting quotas for user 659eff88ab324edf832d12b17c38ce4c and project b4ef3d17aa174b00ade5f3a060dd691a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:34:31.206656 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] [instance: 325efdee-9587-4c62-a20c-09069f0716a6] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:34:31.227048 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:31.227577 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:31.377533 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] [instance: 325efdee-9587-4c62-a20c-09069f0716a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:34:31.380802 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:31.381878 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:31.796661 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:31.797447 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5f06a8e8-0b00-413c-a5b7-73ed237abc3e tempest-ServerAddressesNegativeTestJSON-1395520924 tempest-ServerAddressesNegativeTestJSON-1395520924-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:36.296309 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:34:36.332737 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:36.333349 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:36.541161 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:36.542125 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:36.543581 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:36.544510 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:36.573403 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Getting quotas for project 70fb101e6ebf41c5850210f720011719. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:34:36.582598 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Getting quotas for user cbbb3edae4964dcfac9a13c0f3348d8b and project 70fb101e6ebf41c5850210f720011719. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:34:36.607473 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] [instance: 3f1f0780-6dce-425a-95ff-9410859aee3c] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:34:36.608695 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:36.609098 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:36.739976 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] [instance: 3f1f0780-6dce-425a-95ff-9410859aee3c] block_device_mapping [BlockDeviceMapping(attachment_id=66686ff0-3091-4423-8d07-0350bf80c7cc,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ffb8b37-493d-4c64-b792-018ed2b2bbad',volume_size=1,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:34:36.741299 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:36.741908 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:37.099625 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:37.101122 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50b31b59-f8d3-4188-9d0d-4fe588e9d80e tempest-ServersTestBootFromVolume-884803344 tempest-ServersTestBootFromVolume-884803344-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:38.200574 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:34:38.247716 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:38.248966 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:38.462309 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:38.462606 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:38.464209 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:38.464721 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:38.492124 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Getting quotas for project 932326a9936a4f1e80bbe77d73adb5b6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:34:38.499740 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Getting quotas for user aac30faf7b224c7f8116255758372805 and project 932326a9936a4f1e80bbe77d73adb5b6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:34:38.519746 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: 3d42a2f0-1976-43e7-94af-2f029b3a9896] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:34:38.520990 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:38.521537 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:38.597241 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] [instance: 3d42a2f0-1976-43e7-94af-2f029b3a9896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:34:38.599661 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:38.600213 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:38.939445 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:38.941760 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-d093d797-7542-420c-9b40-72d9b1c60b7e tempest-MigrationsAdminTest-1684304521 tempest-MigrationsAdminTest-1684304521-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:41.716041 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:34:41.785997 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:41.788427 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:41.962435 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:41.964763 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:41.967286 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:41.967975 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:42.010986 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:34:42.017579 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for user 5c30efe732914d2db9cf6a6f8c5c8d9a and project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:34:42.035605 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: 499c877e-673b-4301-88e4-bf330e6266e6] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:34:42.035605 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:42.035605 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:42.116374 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: 499c877e-673b-4301-88e4-bf330e6266e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:34:42.118693 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:42.119285 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:42.511423 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:34:42.512107 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8154c098-f252-4a69-9d7d-4c5351d5187c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:34:55.781693 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:35:06.059599 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6bf49c28-c342-4eba-a971-ed75d6fda053 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:35:06.060415 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6bf49c28-c342-4eba-a971-ed75d6fda053 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:06.061095 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6bf49c28-c342-4eba-a971-ed75d6fda053 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:06.635770 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-6bf49c28-c342-4eba-a971-ed75d6fda053 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] [instance: 3d42a2f0-1976-43e7-94af-2f029b3a9896] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99476) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 14:35:07.637914 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-6bf49c28-c342-4eba-a971-ed75d6fda053 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] Created allocations for migration 57fbfe8e-43e8-4194-86ad-dd40b4ead0e1 on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 14:35:08.465268 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-6bf49c28-c342-4eba-a971-ed75d6fda053 tempest-MigrationsAdminTest-1326295408 tempest-MigrationsAdminTest-1326295408-project-admin] [instance: 3d42a2f0-1976-43e7-94af-2f029b3a9896] Calling prep_resize with selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99476) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 14:35:42.675925 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:35:42.741114 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:42.742436 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:43.048087 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:43.048691 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:43.049647 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:43.050184 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:43.086637 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Getting quotas for project 7f43358c8ee3460cbb228c5c8e133bb0. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:35:43.092781 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Getting quotas for user 809fb5182b2b444ab1cc8bcdf2961961 and project 7f43358c8ee3460cbb228c5c8e133bb0. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:35:43.118871 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] [instance: 5c89a470-c793-4d09-b84d-190d57e91dea] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:35:43.120015 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:43.121083 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:43.237870 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] [instance: 5c89a470-c793-4d09-b84d-190d57e91dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:35:43.239846 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:43.240577 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:43.663643 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:43.664325 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-9e5a62f9-cd2b-49b9-ada9-cf17d3ef154e tempest-ServerAddressesTestJSON-1477715042 tempest-ServerAddressesTestJSON-1477715042-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:55.418612 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Took 1.19 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:35:55.468210 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:55.468849 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:55.782140 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:55.795249 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:55.797345 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:55.801720 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:55.844782 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Getting quotas for project 931e66aed44741bd8712cc721a470907. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:35:55.855745 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Getting quotas for user f573c50b532e411298b122042031a322 and project 931e66aed44741bd8712cc721a470907. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:35:55.890287 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] [instance: b8e4474b-b4af-4c58-8002-5f8c5d71ea76] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:35:55.891912 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:55.892511 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:56.078910 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] [instance: b8e4474b-b4af-4c58-8002-5f8c5d71ea76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:35:56.080735 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:56.081156 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:35:56.521043 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:35:56.523287 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1b17b708-8f80-4212-a455-e57600e5a3d5 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:29.452727 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Took 1.21 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:36:29.487839 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:29.488464 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:29.684425 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:29.685124 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:29.686092 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:29.686684 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:29.708451 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:36:29.716444 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for user 5c30efe732914d2db9cf6a6f8c5c8d9a and project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:36:29.734880 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: c76191df-87d6-4902-ae1e-e79e2a2d8d9e] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:36:29.735946 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:29.736216 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:29.864090 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: c76191df-87d6-4902-ae1e-e79e2a2d8d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:36:29.865807 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:29.866398 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:30.306718 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:30.307326 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4974ec40-8306-48c3-90aa-968730b63b76 tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:30.324917 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:36:30.362442 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:30.364888 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:30.561916 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:30.562694 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:30.564008 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:30.564739 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:30.599553 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Getting quotas for project 3f1a097e6beb43728441478089e10688. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:36:30.606105 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Getting quotas for user 2aa2d8ae0f6941eba810ee8b9b37303c and project 3f1a097e6beb43728441478089e10688. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:36:30.621443 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] [instance: de8f6986-9958-4193-b1a2-553d86491774] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:36:30.622868 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:30.623426 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:30.729628 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] [instance: de8f6986-9958-4193-b1a2-553d86491774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:36:30.731656 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:30.732126 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:31.087197 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:36:31.088310 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-05354a3a-ddf4-46bd-9ff9-64b77a832d78 tempest-ServerPasswordTestJSON-1882052388 tempest-ServerPasswordTestJSON-1882052388-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:36:51.075664 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:36:52.101701 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56908. May 19 14:37:09.343015 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:37:09.374056 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:09.374714 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:09.519981 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:09.520678 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:09.525147 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:09.525147 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:09.549947 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:37:09.555352 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for user 68c80c83fbaf44e1b9654922391b2fa7 and project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:37:09.570310 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: 2a4b3d0e-4826-4723-9893-aa4c8ae3761d] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:37:09.572981 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:09.573495 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:09.638098 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: 2a4b3d0e-4826-4723-9893-aa4c8ae3761d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:37:09.641307 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:09.641935 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:09.985743 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:09.986386 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-13173cb4-0c37-4025-a6bf-08aa24d2ea29 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:19.490059 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:37:20.528689 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57612. May 19 14:37:30.526741 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Took 1.31 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:37:30.603314 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:30.603314 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:30.931435 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:30.938444 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:30.942324 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:30.943426 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:30.984307 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Getting quotas for project 3c55b4a2f9234ea3a3d2732784fd7ec8. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:37:30.996365 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Getting quotas for user 4ac71142005a499c8ff45974f55f722b and project 3c55b4a2f9234ea3a3d2732784fd7ec8. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:37:31.027848 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] [instance: c2281f95-677f-4ea2-9df3-deb78aefb5ba] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:37:31.027848 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:31.027848 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:31.142264 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] [instance: c2281f95-677f-4ea2-9df3-deb78aefb5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:37:31.145130 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:31.146451 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:31.483237 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:31.483237 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ed4823f0-97f3-4d54-8d27-7d665ef3c424 tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:34.447835 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:37:34.512573 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:34.513853 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:34.714833 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:34.715664 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:34.716645 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:34.717356 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:34.756967 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:37:34.799393 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Getting quotas for user 5c30efe732914d2db9cf6a6f8c5c8d9a and project 0254d642d1b344bca7dbd0cd7311c863. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:37:34.870060 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: 6402eee9-5088-4a00-8c8c-3e51fefa5220] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:37:34.885469 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:34.886176 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:35.051954 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] [instance: 6402eee9-5088-4a00-8c8c-3e51fefa5220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:37:35.057895 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:35.058509 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:35.370955 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:35.371626 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-8a087fdb-3fae-4312-8523-e3c2e6ce0f2c tempest-DeleteServersTestJSON-1715476144 tempest-DeleteServersTestJSON-1715476144-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:37:59.765100 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:37:59.830538 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:37:59.831308 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:00.281755 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:00.282427 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:00.283367 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:00.284066 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:00.304104 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Getting quotas for project 6518d4566ea440cbb9c2054398140d74. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:38:00.310572 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Getting quotas for user 9932f41d5fd745d0a0dfa2a6744ce342 and project 6518d4566ea440cbb9c2054398140d74. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:38:00.326820 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] [instance: 0589eefc-27fa-4502-9742-94bc2d225178] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:38:00.328046 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:00.328601 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:00.442746 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] [instance: 0589eefc-27fa-4502-9742-94bc2d225178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a638a17c-c9ed-4f9c-a673-07f23856dcda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:38:00.445140 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:00.445879 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:00.903649 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:00.904319 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e5e4b03f-4269-443a-b824-4770baf7b350 tempest-AttachSCSIVolumeTestJSON-2012825945 tempest-AttachSCSIVolumeTestJSON-2012825945-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:04.879363 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:38:04.962899 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:04.963593 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:05.250863 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:05.253301 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:05.255110 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:05.255795 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:05.345148 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:38:05.376425 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for user 68c80c83fbaf44e1b9654922391b2fa7 and project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:38:05.408336 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: 734b8625-03cd-4a60-bdab-6fb98db3c500] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:38:05.411573 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:05.412911 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:05.546877 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: 734b8625-03cd-4a60-bdab-6fb98db3c500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:38:05.554710 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:05.555944 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:06.009976 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:06.009976 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b8831360-f0b8-4765-b1d1-6d5a4e2f84a7 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:15.843735 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:38:32.655860 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:38:32.733551 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:32.734196 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:33.019683 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:33.020367 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:33.022215 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:33.023342 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:33.069749 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Getting quotas for project 3c55b4a2f9234ea3a3d2732784fd7ec8. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:38:33.083604 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Getting quotas for user 4ac71142005a499c8ff45974f55f722b and project 3c55b4a2f9234ea3a3d2732784fd7ec8. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:38:33.140374 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] [instance: 756f544f-b3b8-4540-8668-6d7f3cd02ba2] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:38:33.146975 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:33.150058 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:33.263053 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] [instance: 756f544f-b3b8-4540-8668-6d7f3cd02ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:38:33.264576 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:33.265328 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:33.481049 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:33.481487 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-24caeb3a-39d2-4eb6-9675-d22ef1b86c2d tempest-ServerRescueTestJSON-673678728 tempest-ServerRescueTestJSON-673678728-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:43.957371 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:38:43.987207 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:43.987843 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:44.586109 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:44.586835 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:44.588336 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:44.588921 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:44.638309 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Getting quotas for project d196a0c3f7d84241bca4213f9092863c. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:38:44.645890 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Getting quotas for user 0b1f7abf959a41a3b4e4a799d410b9b2 and project d196a0c3f7d84241bca4213f9092863c. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:38:44.695638 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] [instance: af7cf9e8-70ed-4d39-8b6f-eba5dced8210] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:38:44.697878 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:44.699141 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:44.807930 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] [instance: af7cf9e8-70ed-4d39-8b6f-eba5dced8210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:38:44.807930 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:44.807930 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:38:45.108307 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:38:45.109095 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-174a6f20-7dfa-4d7e-826d-9ae615c29681 tempest-InstanceActionsTestJSON-2039705613 tempest-InstanceActionsTestJSON-2039705613-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:01.410834 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7d9a27ef-4aea-49cb-a5f0-b751d023cdf0 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method unshelve_instance {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:39:01.412089 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7d9a27ef-4aea-49cb-a5f0-b751d023cdf0 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:01.413062 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7d9a27ef-4aea-49cb-a5f0-b751d023cdf0 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:02.524881 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7d9a27ef-4aea-49cb-a5f0-b751d023cdf0 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] [instance: b8e4474b-b4af-4c58-8002-5f8c5d71ea76] Requesting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) during scheduling {{(pid=99476) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 19 14:39:03.060220 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7d9a27ef-4aea-49cb-a5f0-b751d023cdf0 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:39:03.063716 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-7d9a27ef-4aea-49cb-a5f0-b751d023cdf0 tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lazy-loading 'flavor' on Instance uuid b8e4474b-b4af-4c58-8002-5f8c5d71ea76 {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:39:28.222140 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:39:28.256749 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:28.258358 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:28.451353 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:28.451610 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:28.454085 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:28.454486 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:28.489985 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Getting quotas for project b4a59254cfce44a897aea74401d91444. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:39:28.495210 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Getting quotas for user 19446f59a204467ca11d44fa2219e34a and project b4a59254cfce44a897aea74401d91444. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:39:28.525884 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] [instance: 9b44d7b9-6a5d-4408-8eff-0a419975e958] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:39:28.526860 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:28.527270 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:28.588669 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] [instance: 9b44d7b9-6a5d-4408-8eff-0a419975e958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:39:28.608066 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:28.608066 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:28.850917 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:28.851524 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0a367bf6-2b9f-4783-a277-5a22f5b4c0f2 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:41.136711 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:39:41.177731 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:41.179066 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:41.467304 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:41.468184 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:41.470359 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:41.471061 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:41.495532 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Getting quotas for project ef259db844be442aae5b98b21b2809c9. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:39:41.504803 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Getting quotas for user 205aa7608ac64470b14a7fae30ee814c and project ef259db844be442aae5b98b21b2809c9. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:39:41.522243 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] [instance: 02be38c3-70c7-41af-9fad-c66b1ff475b8] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:39:41.523211 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:41.523622 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:41.593493 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] [instance: 02be38c3-70c7-41af-9fad-c66b1ff475b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:39:41.596117 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:41.597039 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:42.116549 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:42.118127 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f2c668bd-a65b-4e26-91e3-bfa3bd8d6275 tempest-InstanceActionsNegativeTestJSON-1948903063 tempest-InstanceActionsNegativeTestJSON-1948903063-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:52.102003 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:39:53.132234 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60134. May 19 14:39:57.394883 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:39:57.453957 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:57.454714 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:57.710249 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:57.710684 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:57.711466 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:57.712181 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:57.734979 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Getting quotas for project 83e3714f6fb04fb5b61298e186f42673. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:39:57.740509 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Getting quotas for user 618c41e6cf81417a98103314b2bb4f62 and project 83e3714f6fb04fb5b61298e186f42673. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:39:57.754489 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] [instance: 6896e7ec-b4f2-4e65-991a-83b129809554] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:39:57.755810 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:57.756376 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:58.212339 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] [instance: 6896e7ec-b4f2-4e65-991a-83b129809554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:39:58.215671 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:58.216710 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:39:58.552143 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:39:58.554115 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-910aceee-90b4-4947-9e1c-6100b6e2344b tempest-ImagesNegativeTestJSON-1968422991 tempest-ImagesNegativeTestJSON-1968422991-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:14.765665 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:40:14.896731 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:14.903094 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:15.278979 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:15.283795 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:15.288283 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:15.288283 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:15.324647 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Getting quotas for project b4a59254cfce44a897aea74401d91444. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:40:15.338373 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Getting quotas for user 19446f59a204467ca11d44fa2219e34a and project b4a59254cfce44a897aea74401d91444. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:40:15.366107 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] [instance: ce0d0772-4c62-4b89-ac9b-3b6e5f602a5d] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:40:15.367423 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:15.368068 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:15.439376 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] [instance: ce0d0772-4c62-4b89-ac9b-3b6e5f602a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:40:15.443355 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:15.444431 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:15.802094 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:15.802887 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-fd8b4dc5-7a5a-4dd2-8fb7-60929f04a0fd tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:19.577888 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:40:19.628044 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:19.630010 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:19.892620 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:19.892620 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:19.892620 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:19.892620 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:19.921506 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Getting quotas for project 70bbd046b72041c9b44cff28339aefc0. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:40:19.927112 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Getting quotas for user 8950b9e8faa443f2bf7071a6de81596b and project 70bbd046b72041c9b44cff28339aefc0. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:40:19.941276 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] [instance: a2796206-b314-495c-b074-c4bdbff34479] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:40:19.942524 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:19.943122 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:20.088241 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] [instance: a2796206-b314-495c-b074-c4bdbff34479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:40:20.089576 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:20.090253 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:20.489689 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:20.490352 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-482dd198-bc55-4657-bfc6-3833866ef68a tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:20.563613 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:40:21.359131 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:40:21.413326 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:21.413796 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:21.535010 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:21.535435 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:21.536174 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:21.536574 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:21.630786 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Getting quotas for project 70bbd046b72041c9b44cff28339aefc0. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:40:21.638711 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60916. May 19 14:40:21.648899 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Getting quotas for user 8950b9e8faa443f2bf7071a6de81596b and project 70bbd046b72041c9b44cff28339aefc0. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:40:21.697407 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] [instance: b1e292b4-e64b-41c9-b525-9a1ce3463755] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:40:21.698465 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:21.698868 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:21.818568 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] [instance: b1e292b4-e64b-41c9-b525-9a1ce3463755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:40:21.819805 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:21.820520 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:22.183529 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:22.183944 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7f22cd6-dade-43b7-980b-a08105d7deee tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:30.636638 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-cf79d417-c679-428e-8d04-acfd54938420 tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method rebuild_instance {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:40:30.639261 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-cf79d417-c679-428e-8d04-acfd54938420 tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:30.639793 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-cf79d417-c679-428e-8d04-acfd54938420 tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:30.768657 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-cf79d417-c679-428e-8d04-acfd54938420 tempest-ServerShowV247Test-181623483 tempest-ServerShowV247Test-181623483-project] [instance: b1e292b4-e64b-41c9-b525-9a1ce3463755] No migration record for the rebuild/evacuate request. {{(pid=99477) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 19 14:40:35.810560 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:40:35.861498 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:35.877873 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:36.122243 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:36.122982 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:36.126197 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:36.126999 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:36.151767 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Getting quotas for project c7ea508265834e45b6872bd02d132229. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:40:36.160484 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Getting quotas for user 6cd675266a584cb1b2a5e392613bbce9 and project c7ea508265834e45b6872bd02d132229. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:40:36.200619 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] [instance: 14a3647d-b5ff-43fb-b8a8-c086631176a3] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:40:36.202458 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:36.203111 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:36.275894 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] [instance: 14a3647d-b5ff-43fb-b8a8-c086631176a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:40:36.279695 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:36.280182 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:36.551330 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:36.551830 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-aa78163e-0e63-4956-ad57-5445c7a9d7d4 tempest-ImagesOneServerTestJSON-815851996 tempest-ImagesOneServerTestJSON-815851996-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:47.642365 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:40:47.670187 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:47.671338 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:47.802405 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:47.802813 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:47.803603 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:47.804017 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:47.823382 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Getting quotas for project b4a59254cfce44a897aea74401d91444. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:40:47.828683 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Getting quotas for user 19446f59a204467ca11d44fa2219e34a and project b4a59254cfce44a897aea74401d91444. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:40:47.841143 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] [instance: 2967b30c-31c7-4d06-810d-78c052891cce] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:40:47.842094 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:47.842540 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:47.938920 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] [instance: 2967b30c-31c7-4d06-810d-78c052891cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:40:47.940391 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:47.941030 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:48.287595 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:48.288254 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ca06598e-b7dc-4049-a324-c5494d8b9b74 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:49.042188 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:40:49.071457 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:49.071969 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:49.265808 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:49.266234 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:49.266973 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:49.267382 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:49.286022 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Getting quotas for project 931e66aed44741bd8712cc721a470907. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:40:49.291079 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Getting quotas for user f573c50b532e411298b122042031a322 and project 931e66aed44741bd8712cc721a470907. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:40:49.303134 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] [instance: 4c6b19d0-52c5-49de-a848-a00d8bc43ad3] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:40:49.304081 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:49.304490 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:49.405259 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] [instance: 4c6b19d0-52c5-49de-a848-a00d8bc43ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:40:49.406733 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:49.407296 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:49.807460 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:49.808531 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e7b5d625-6dd1-497c-b7f1-455944c98b4e tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:52.716066 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:40:52.805889 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:52.807771 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:53.072432 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:53.073091 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:53.074150 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:53.081939 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:53.139841 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Getting quotas for project f095c53e82374cc18a1ead2bf925402f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:40:53.156519 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Getting quotas for user 9f8c617af9954702938ed3cdd0c65781 and project f095c53e82374cc18a1ead2bf925402f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:40:53.195783 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] [instance: 23ea0d74-d6bc-4d1b-bc99-3e2374c05f3a] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:40:53.199021 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:53.201523 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:53.316645 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] [instance: 23ea0d74-d6bc-4d1b-bc99-3e2374c05f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:40:53.318339 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:53.318858 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:53.734841 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:53.735546 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-771cc44d-15e6-47ed-9f49-c562c66e5712 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:56.580435 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Took 1.14 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:40:56.624747 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:56.625168 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:56.830615 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:56.831405 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:56.832347 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:56.833278 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:56.914812 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Getting quotas for project f095c53e82374cc18a1ead2bf925402f. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:40:56.921161 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Getting quotas for user 9f8c617af9954702938ed3cdd0c65781 and project f095c53e82374cc18a1ead2bf925402f. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:40:56.944570 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] [instance: f0abb749-6e45-4cba-bf54-33cdcb597354] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:40:56.945450 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:56.950214 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:57.178656 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] [instance: f0abb749-6e45-4cba-bf54-33cdcb597354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:40:57.181649 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:57.181649 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:57.818970 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:57.825927 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-107fec51-d9b9-45e0-95e5-f1a6effaf940 tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:59.315180 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:40:59.346417 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:59.347635 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:59.463268 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:59.468475 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:59.469535 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:59.469961 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:59.509278 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Getting quotas for project f095c53e82374cc18a1ead2bf925402f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:40:59.535352 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Getting quotas for user 9f8c617af9954702938ed3cdd0c65781 and project f095c53e82374cc18a1ead2bf925402f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:40:59.582671 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] [instance: 7c47bfff-f168-42d5-81ff-77eceb74354a] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:40:59.583753 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:59.584355 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:40:59.741970 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] [instance: 7c47bfff-f168-42d5-81ff-77eceb74354a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:40:59.743646 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:40:59.744242 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:00.384780 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:00.386758 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad5fc115-afbf-4041-a752-4ef701abf59f tempest-ListServerFiltersTestJSON-1386056099 tempest-ListServerFiltersTestJSON-1386056099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:35.884951 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:41:37.383354 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:41:37.439142 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:37.442439 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:37.679673 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:37.682673 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:37.683759 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:37.684417 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:37.706415 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:41:37.713289 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for user 68c80c83fbaf44e1b9654922391b2fa7 and project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:41:37.744808 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: 4d52f676-a40b-46c4-9077-f400e563f195] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:41:37.763426 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:37.764081 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:37.859568 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: 4d52f676-a40b-46c4-9077-f400e563f195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:41:37.861846 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:37.863041 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:38.389958 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:38.390988 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bccb75c4-0d1b-456c-a145-a07c3dd2f0e4 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:39.234961 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:41:39.303551 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:39.304254 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:39.584573 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:39.588478 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:39.589387 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:39.591500 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:39.650330 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Getting quotas for project c119e0c80191418fbcdeaa8bca24ba4c. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:41:39.663131 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Getting quotas for user 9d6ca1c5330142a9a4deb1177b5e1c77 and project c119e0c80191418fbcdeaa8bca24ba4c. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:41:39.696934 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] [instance: cf76ea7e-55ab-40f4-b656-96c5b4ec1851] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:41:39.709859 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:39.710447 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:39.800144 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] [instance: cf76ea7e-55ab-40f4-b656-96c5b4ec1851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:41:39.801483 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:39.801893 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:40.205986 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:40.206399 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ed6a61f5-e711-44bc-b3a7-9abf3ca01c65 tempest-ServersNegativeTestMultiTenantJSON-678795320 tempest-ServersNegativeTestMultiTenantJSON-678795320-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:48.356194 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:41:48.451023 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:48.455323 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:48.656756 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:48.657218 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:48.678467 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:48.678467 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:48.773529 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Getting quotas for project b4a59254cfce44a897aea74401d91444. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:41:48.784844 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Getting quotas for user 19446f59a204467ca11d44fa2219e34a and project b4a59254cfce44a897aea74401d91444. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:41:48.804644 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] [instance: f6e8983f-478f-4025-880e-22d5ff7898c0] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:41:48.807265 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:48.807984 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:48.903593 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] [instance: f6e8983f-478f-4025-880e-22d5ff7898c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:41:48.906601 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:48.909409 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:41:49.500386 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:41:49.506521 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-da898427-cc9d-43dc-a4a5-20994eeb54b5 tempest-AttachVolumeNegativeTest-2026738099 tempest-AttachVolumeNegativeTest-2026738099-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:10.015552 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:42:10.039173 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:10.039466 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:10.220849 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:10.221666 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:10.222631 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:10.223244 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:10.244561 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:42:10.252898 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Getting quotas for user 68c80c83fbaf44e1b9654922391b2fa7 and project a9a0bbcc2599487aa3f550c654606254. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:42:10.269752 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: 655ad6a0-43b0-4e67-94d8-cde46a484ac3] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:42:10.271356 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:10.272205 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:10.362110 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] [instance: 655ad6a0-43b0-4e67-94d8-cde46a484ac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:42:10.363469 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:10.363954 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:10.654648 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:10.655268 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3356a38f-ab8b-4b20-8b8d-c6acda748de1 tempest-ServerActionsTestJSON-101554437 tempest-ServerActionsTestJSON-101554437-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:40.574105 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Took 1.08 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:42:40.620256 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:40.621430 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:41.064737 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:41.065571 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:41.068064 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:41.068908 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:41.103621 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Getting quotas for project 3397a3a364404042bc0aaaca75ab222b. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:42:41.120157 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Getting quotas for user 250aea3d965c4ed0b52a87262218dddc and project 3397a3a364404042bc0aaaca75ab222b. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:42:41.151918 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] [instance: 2ac685eb-3464-4338-b15b-55acb771e13f] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:42:41.153236 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:41.153834 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:41.328877 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] [instance: 2ac685eb-3464-4338-b15b-55acb771e13f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:42:41.331328 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:41.332231 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:41.875239 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:42:41.877535 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-36487acb-eac4-41a5-af4e-f08e3f82d667 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:42:53.132500 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:42:54.210125 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36434. May 19 14:43:21.636536 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:43:22.674876 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36930. May 19 14:43:44.445270 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Took 1.78 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:43:44.579969 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:44.580919 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:45.380747 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Took 2.32 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:43:45.541133 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:45.545296 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:45.548253 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:45.548253 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:45.550150 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:45.551191 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:45.595341 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Getting quotas for project 7c2de80e63ff43a680dfadd590d8e4ce. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:43:45.623681 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Getting quotas for user 701a357608f44d2c816872ce61bebe4f and project 7c2de80e63ff43a680dfadd590d8e4ce. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:43:45.678961 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] [instance: 7386f775-8737-4a55-8012-d7b20daec948] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:43:45.680449 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:45.682051 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:45.796146 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] [instance: 7386f775-8737-4a55-8012-d7b20daec948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:43:45.798004 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:45.798751 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:45.901123 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:45.903104 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:45.909004 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:45.910065 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:45.986332 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Getting quotas for project 439f7c72af3e499c80e66c0ecbaa35c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:43:46.019885 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Getting quotas for user d87f59e5359b43b5beb84cdcb91c7172 and project 439f7c72af3e499c80e66c0ecbaa35c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:43:46.049520 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] [instance: e179f8ba-988d-4bf9-8177-1ed6298eec1e] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:43:46.050716 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:46.051391 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:46.124030 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:46.124630 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be28e298-5262-4e29-885f-cb60667bf4f5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:46.141683 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] [instance: e179f8ba-988d-4bf9-8177-1ed6298eec1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:43:46.144410 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:46.145381 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:46.467623 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:46.468703 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ca8b5d8-98ca-4718-8305-ecd33f652659 tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:49.373839 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:43:49.479600 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:49.492861 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:49.742775 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:49.743488 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:49.744931 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:49.744931 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:49.794629 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Getting quotas for project 7c2de80e63ff43a680dfadd590d8e4ce. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:43:49.810765 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Getting quotas for user 701a357608f44d2c816872ce61bebe4f and project 7c2de80e63ff43a680dfadd590d8e4ce. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:43:49.843642 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] [instance: 598e2bcd-2a27-4c4a-ad89-a80388ded831] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:43:49.844992 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:49.845660 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:50.008833 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] [instance: 598e2bcd-2a27-4c4a-ad89-a80388ded831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:43:50.008833 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:50.008833 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:50.485512 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:43:50.485512 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2917104c-2c6d-45b7-adb6-95c6c4d335d5 tempest-ServerRescueNegativeTestJSON-1630754518 tempest-ServerRescueNegativeTestJSON-1630754518-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:43:50.828252 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:44:19.348007 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f3e6b5ab-e6de-4066-bfdd-02582a49af5d tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method unshelve_instance {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:44:19.350031 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f3e6b5ab-e6de-4066-bfdd-02582a49af5d tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:19.352792 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f3e6b5ab-e6de-4066-bfdd-02582a49af5d tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:21.501438 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f3e6b5ab-e6de-4066-bfdd-02582a49af5d tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] [instance: 4c6b19d0-52c5-49de-a848-a00d8bc43ad3] Requesting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) during scheduling {{(pid=99476) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 19 14:44:22.563292 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f3e6b5ab-e6de-4066-bfdd-02582a49af5d tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:44:22.625312 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-f3e6b5ab-e6de-4066-bfdd-02582a49af5d tempest-AttachVolumeShelveTestJSON-1776752858 tempest-AttachVolumeShelveTestJSON-1776752858-project] Lazy-loading 'flavor' on Instance uuid 4c6b19d0-52c5-49de-a848-a00d8bc43ad3 {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:44:32.604266 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:44:32.667675 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:32.671207 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:32.948350 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:32.951727 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:32.954593 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:32.955997 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:33.018740 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Getting quotas for project 3397a3a364404042bc0aaaca75ab222b. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:44:33.029553 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Getting quotas for user 250aea3d965c4ed0b52a87262218dddc and project 3397a3a364404042bc0aaaca75ab222b. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:44:33.060387 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] [instance: c2597197-c735-48de-a62a-81535f2b479a] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:44:33.061811 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:33.062270 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:33.226632 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] [instance: c2597197-c735-48de-a62a-81535f2b479a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:44:33.228181 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:33.228582 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:33.614776 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:33.615815 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2da8bf1a-7b96-46f1-86fb-ab322c7beb89 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:37.911010 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:44:37.977511 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:37.985015 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:38.396529 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:38.398083 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:38.415683 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:38.417074 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:38.511872 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Getting quotas for project 439f7c72af3e499c80e66c0ecbaa35c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:44:38.525825 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Getting quotas for user d87f59e5359b43b5beb84cdcb91c7172 and project 439f7c72af3e499c80e66c0ecbaa35c6. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:44:38.572241 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] [instance: e2425fd8-2f54-40b5-9fa8-6188c01cf99c] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:44:38.573340 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:38.573855 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:38.751945 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] [instance: e2425fd8-2f54-40b5-9fa8-6188c01cf99c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:44:38.758925 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:38.760208 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:39.265833 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:44:39.266501 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-14b8844d-2bee-4f39-8a45-e26b3ab1727d tempest-VolumesActionsTest-1802134911 tempest-VolumesActionsTest-1802134911-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:44:55.917022 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:45:30.891536 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:45:30.951177 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:45:30.952757 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:45:31.151248 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:45:31.154280 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:45:31.155681 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:45:31.156450 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:45:31.190943 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Getting quotas for project 3397a3a364404042bc0aaaca75ab222b. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:45:31.201560 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Getting quotas for user 250aea3d965c4ed0b52a87262218dddc and project 3397a3a364404042bc0aaaca75ab222b. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:45:31.299333 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] [instance: 80a6efaa-77cd-4ea0-b9a6-8fedfec14286] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:45:31.306448 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:45:31.311838 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:45:31.413393 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] [instance: 80a6efaa-77cd-4ea0-b9a6-8fedfec14286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:45:31.416071 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:45:31.416336 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:45:31.743814 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:45:31.744183 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-de460280-69f7-4d05-ac3e-f9e1915ffe73 tempest-ImagesOneServerNegativeTestJSON-2075703555 tempest-ImagesOneServerNegativeTestJSON-2075703555-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:45:54.226843 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:45:55.293480 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39444. May 19 14:46:22.675664 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:46:23.740208 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39896. May 19 14:46:38.157614 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:46:38.711614 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] [9f98c8e4-1fd7-4463-8f6a-62e7597d1031] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 14:46:39.213346 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40184. May 19 14:46:39.775978 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] [9f98c8e4-1fd7-4463-8f6a-62e7597d1031] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40216. May 19 14:46:41.130245 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Took 2.44 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:46:41.208449 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:46:41.208863 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:46:41.473605 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:46:41.477849 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:46:41.478806 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:46:41.479217 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:46:41.518502 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Getting quotas for project c6ef31d8b1fd40e6858a56142aa225fb. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:46:41.541410 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Getting quotas for user 0afcdea4f08947bdbc217bcbbdeafeee and project c6ef31d8b1fd40e6858a56142aa225fb. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:46:41.578431 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] [instance: 9cdf0075-6224-4b41-bf7f-65a05a608139] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:46:41.580131 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:46:41.580879 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:46:41.665600 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] [instance: 9cdf0075-6224-4b41-bf7f-65a05a608139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:46:41.667280 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:46:41.677932 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:46:42.124564 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:46:42.125893 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:46:42.156081 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] [f0027548-7dd5-4cd6-ade6-3ed4ce196adb] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 14:46:43.228787 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f6b87b0-46b4-4b34-b4a3-65a3efbdf6c0 tempest-ServerMetadataNegativeTestJSON-2087681674 tempest-ServerMetadataNegativeTestJSON-2087681674-project] [f0027548-7dd5-4cd6-ade6-3ed4ce196adb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40308. May 19 14:47:07.551331 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Took 0.96 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:47:07.579196 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:07.579196 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:07.861740 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:07.862322 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:07.863006 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:07.863402 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:07.915133 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Getting quotas for project ddbac0f7cd234fcea0333974f5a0c067. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:47:07.928684 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Getting quotas for user 36aa8943ed7b433491a6bf60022b443b and project ddbac0f7cd234fcea0333974f5a0c067. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:47:07.970924 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] [instance: eecdab05-bd9a-48e3-9b45-7acf853d3dd0] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:47:07.976113 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:07.979849 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:08.088643 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] [instance: eecdab05-bd9a-48e3-9b45-7acf853d3dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:47:08.096979 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:08.101434 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:08.476730 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:08.477907 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5b447130-2427-4690-9f52-d4670100b43f tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:09.755303 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Took 1.04 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:47:09.803426 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:09.804796 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:09.953802 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:09.954219 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:09.955256 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:09.955933 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:10.009323 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Getting quotas for project ddbac0f7cd234fcea0333974f5a0c067. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:47:10.016314 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Getting quotas for user 36aa8943ed7b433491a6bf60022b443b and project ddbac0f7cd234fcea0333974f5a0c067. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:47:10.066354 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] [instance: 90e970c2-cec0-4f7e-901c-cd49baa733f8] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:47:10.067372 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:10.067780 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:10.172906 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] [instance: 90e970c2-cec0-4f7e-901c-cd49baa733f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:47:10.174975 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:10.175912 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:10.552127 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:47:10.552823 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175bd5d6-e738-4d5b-89c5-d54e4ff4e175 tempest-ListImageFiltersTestJSON-830663121 tempest-ListImageFiltersTestJSON-830663121-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:47:10.857697 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:48:05.100735 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Took 1.10 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:48:05.233579 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:05.234502 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:05.725545 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:05.725545 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:05.725545 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:05.725545 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:05.750226 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Getting quotas for project 9f644a3e68b544f5bad95f7332c34d9f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:48:05.757776 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Getting quotas for user 753d464730314d9b884655098dbf6d55 and project 9f644a3e68b544f5bad95f7332c34d9f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:48:05.775804 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] [instance: 29cf6db9-159f-4ab8-bf35-18c3da5468bd] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:48:05.777806 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:05.778662 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:05.868115 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] [instance: 29cf6db9-159f-4ab8-bf35-18c3da5468bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:48:05.871973 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:05.872978 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:06.399740 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:06.402614 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-50502aab-5b32-415a-b759-15e75543195e tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:06.960793 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Took 1.13 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:48:07.033861 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:07.034461 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:07.687027 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:07.692314 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:07.702830 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:07.707572 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:07.815364 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Getting quotas for project 177bddbaf7c54fd4883236269edd27c7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:48:07.834795 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Getting quotas for user 38ef8d815e5f4c979ec4cb360166a98b and project 177bddbaf7c54fd4883236269edd27c7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:48:07.898605 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] [instance: 4a6a18ba-adab-45e1-98d7-d1a80f228905] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:48:07.907323 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:07.907977 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:08.069852 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] [instance: 4a6a18ba-adab-45e1-98d7-d1a80f228905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:48:08.077221 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:08.077221 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:08.780836 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:08.781529 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-68140abd-46f4-489c-8058-41b805c00aea tempest-ServerTagsTestJSON-362005549 tempest-ServerTagsTestJSON-362005549-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:15.955243 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:48:44.638679 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Took 0.96 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:48:44.701473 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:44.710396 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:45.122427 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:45.124330 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:45.130047 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:45.132690 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:45.206946 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Getting quotas for project 562b557fc9724890836cac7d316e25a5. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:48:45.221328 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Getting quotas for user aab20a77d73e402fb4a97711f11db8ab and project 562b557fc9724890836cac7d316e25a5. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:48:45.260050 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] [instance: 2fe12486-ea8b-4b0c-b445-f1144990c413] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:48:45.262596 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:45.265364 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:45.352039 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] [instance: 2fe12486-ea8b-4b0c-b445-f1144990c413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:48:45.353393 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:45.354030 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:45.791212 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:48:45.793570 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-be25538b-6f69-4c7d-a9a6-f4222de651ea tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:48:55.293938 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:48:56.347425 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42360. May 19 14:49:23.733404 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:49:24.768699 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42760. May 19 14:49:32.388225 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:49:32.432447 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:32.433355 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:32.593055 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:32.593998 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:32.595248 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:32.595930 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:32.622056 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Getting quotas for project 562b557fc9724890836cac7d316e25a5. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:49:32.630001 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Getting quotas for user aab20a77d73e402fb4a97711f11db8ab and project 562b557fc9724890836cac7d316e25a5. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:49:32.646748 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] [instance: 9d413571-16e6-4249-bd50-9e276d23cd7c] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:49:32.650685 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:32.650685 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:32.739446 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] [instance: 9d413571-16e6-4249-bd50-9e276d23cd7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:49:32.741019 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:32.741635 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:33.051650 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:33.052227 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5b0dc3ce-e42c-4e88-a53c-e0922e79da67 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:46.134229 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Took 1.06 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:49:46.198091 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:46.199187 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:46.521864 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:46.524840 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:46.528913 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:46.533618 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:46.575257 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:49:46.597666 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for user 9af71f3e1ecb45979d429126cf67e648 and project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:49:46.658793 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: c30c8742-850f-46fc-ad62-6c89b842ef18] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:49:46.669608 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:46.676075 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:46.762420 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: c30c8742-850f-46fc-ad62-6c89b842ef18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:49:46.765108 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:46.765430 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:49:47.128116 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:49:47.129623 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1cb92641-cc35-4ddd-a82f-51939c936ffa tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:50:22.670854 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-d0947d6b-4a75-4334-9c8c-1ca651abdce3 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:50:22.699713 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-d0947d6b-4a75-4334-9c8c-1ca651abdce3 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: 9dd11dee-6a24-41da-9b15-9463241cac4a] While scheduling instance, the build request was already deleted. {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1572}} May 19 14:50:23.471824 n-d-791503-3 nova-conductor[99476]: WARNING nova.scheduler.client.report [None req-d0947d6b-4a75-4334-9c8c-1ca651abdce3 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Unable to delete allocation for instance 9dd11dee-6a24-41da-9b15-9463241cac4a: (409 {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n consumer generation conflict - expected null but got 1 ", "code": "placement.concurrent_update", "request_id": "req-a2050dbe-2717-41bf-a798-1862b55e5513"}]}): nova.exception.BuildRequestNotFound: BuildRequest not found for instance 9dd11dee-6a24-41da-9b15-9463241cac4a May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server [None req-d0947d6b-4a75-4334-9c8c-1ca651abdce3 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Exception during message handling: nova.exception.AllocationDeleteFailed: Failed to delete allocations for consumer 9dd11dee-6a24-41da-9b15-9463241cac4a. Error: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n consumer generation conflict - expected null but got 1 ", "code": "placement.concurrent_update", "request_id": "req-a2050dbe-2717-41bf-a798-1862b55e5513"}]} May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 1568, in schedule_and_build_instances May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server objects.BuildRequest.get_by_instance_uuid( May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server result = fn(cls, context, *args, **kwargs) May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/objects/build_request.py", line 176, in get_by_instance_uuid May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server return fn(*args, **kwargs) May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/objects/build_request.py", line 171, in _get_by_instance_uuid_from_db May 19 14:50:23.474321 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server raise exception.BuildRequestNotFound(uuid=instance_uuid) May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server nova.exception.BuildRequestNotFound: BuildRequest not found for instance 9dd11dee-6a24-41da-9b15-9463241cac4a May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 1585, in schedule_and_build_instances May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server self.report_client.delete_allocation_for_instance( May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/scheduler/client/report.py", line 73, in wrapper May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server return f(self, *a, **k) May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/scheduler/client/report.py", line 2121, in delete_allocation_for_instance May 19 14:50:23.476403 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server raise exception.AllocationDeleteFailed(consumer_uuid=uuid, May 19 14:50:23.478893 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server nova.exception.AllocationDeleteFailed: Failed to delete allocations for consumer 9dd11dee-6a24-41da-9b15-9463241cac4a. Error: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n consumer generation conflict - expected null but got 1 ", "code": "placement.concurrent_update", "request_id": "req-a2050dbe-2717-41bf-a798-1862b55e5513"}]} May 19 14:50:23.478893 n-d-791503-3 nova-conductor[99476]: ERROR oslo_messaging.rpc.server May 19 14:50:28.763473 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:50:28.937770 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:50:28.938480 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:50:29.196912 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:50:29.199668 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:50:29.201288 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:50:29.202417 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:50:29.252536 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:50:29.258677 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for user 9af71f3e1ecb45979d429126cf67e648 and project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:50:29.274277 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: 9a33287b-60c6-4125-bbf4-7f9265e08ae5] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:50:29.275772 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:50:29.276777 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:50:29.356472 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: 9a33287b-60c6-4125-bbf4-7f9265e08ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:50:29.360910 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:50:29.362245 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:50:29.657067 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:50:29.657655 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b83602a-87ef-4369-a958-4c7b3ffb5ef9 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:50:30.897913 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:51:10.078632 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:51:10.142431 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:10.143017 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:10.392559 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:10.392962 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:10.393958 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:10.394381 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:10.415184 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:51:10.421537 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for user 9af71f3e1ecb45979d429126cf67e648 and project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:51:10.436724 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: 16fa1738-bd64-4968-86f8-fcf8b814af91] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:51:10.437854 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:10.438304 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:10.541739 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: 16fa1738-bd64-4968-86f8-fcf8b814af91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:51:10.543597 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:10.545325 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:10.834312 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:10.835586 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8a4ebb06-a8b1-43ae-b86a-9e021a25790a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:35.985345 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:51:49.390466 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Took 1.29 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:51:49.499820 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:49.500288 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:49.710685 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:49.714084 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:49.718816 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:49.719502 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:49.807555 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:51:49.824046 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for user 9af71f3e1ecb45979d429126cf67e648 and project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:51:49.854151 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: 15083e84-7bc9-49f9-8253-2d252a71f181] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:51:49.855548 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:49.856078 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:50.002582 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: 15083e84-7bc9-49f9-8253-2d252a71f181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:51:50.004581 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:50.005089 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:50.373793 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:51:50.375039 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-31c32804-98de-46b3-94b5-2238a9d87341 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:51:56.343689 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:51:57.388655 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 45498. May 19 14:52:22.619143 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Took 1.15 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:52:22.766295 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:52:22.772571 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:52:23.043179 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:52:23.046614 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:52:23.050970 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:52:23.051874 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:52:23.101129 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:52:23.113507 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for user 9af71f3e1ecb45979d429126cf67e648 and project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:52:23.142208 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: fc0cf4b4-bb8f-43c9-8a80-eb31b2a2e6b4] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:52:23.144073 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:52:23.144891 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:52:23.274375 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: fc0cf4b4-bb8f-43c9-8a80-eb31b2a2e6b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:52:23.277326 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:52:23.278142 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:52:23.823761 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:52:23.826115 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-175fa2aa-b517-4e0e-8149-4cff4b9addfe tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:52:24.753737 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:52:25.798657 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46012. May 19 14:52:49.626045 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-0edf0fe8-194d-4939-8830-833e44a5aaf6 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method unshelve_instance {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 14:52:49.628393 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0edf0fe8-194d-4939-8830-833e44a5aaf6 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:52:49.629812 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0edf0fe8-194d-4939-8830-833e44a5aaf6 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:52:51.853915 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-0edf0fe8-194d-4939-8830-833e44a5aaf6 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] [instance: 2fe12486-ea8b-4b0c-b445-f1144990c413] Requesting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) during scheduling {{(pid=99477) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 19 14:52:52.714309 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-0edf0fe8-194d-4939-8830-833e44a5aaf6 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:52:52.760024 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-0edf0fe8-194d-4939-8830-833e44a5aaf6 tempest-ServersNegativeTestJSON-612526622 tempest-ServersNegativeTestJSON-612526622-project] Lazy-loading 'flavor' on Instance uuid 2fe12486-ea8b-4b0c-b445-f1144990c413 {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 14:53:28.462999 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:53:28.596134 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:53:28.596734 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:53:28.915673 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:53:28.916748 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:53:28.922721 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:53:28.924183 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:53:28.982955 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:53:29.001638 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for user 9af71f3e1ecb45979d429126cf67e648 and project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:53:29.045749 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: 0674e891-3e83-4510-9cbd-60086d96a0b7] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:53:29.046744 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:53:29.047154 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:53:29.245572 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: 0674e891-3e83-4510-9cbd-60086d96a0b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:53:29.249896 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:53:29.250391 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:53:29.616009 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:53:29.617444 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-7910dba3-2186-49c5-a496-30557fecfe4a tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:53:50.922876 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:54:10.730000 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:54:10.804606 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:10.806370 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:10.996679 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:10.997747 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:10.999498 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:11.000347 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:11.030481 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:54:11.037854 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Getting quotas for user 9af71f3e1ecb45979d429126cf67e648 and project 1c80a0e9fd2a403f8e33115a1906902a. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:54:11.062978 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: a2644a92-d11d-4986-bc5b-b3088ade94e3] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:54:11.064521 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:11.065353 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:11.199863 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] [instance: a2644a92-d11d-4986-bc5b-b3088ade94e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:54:11.202896 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:11.204104 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:11.762700 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:11.763641 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6d53d721-d119-4695-92bc-ab2014761284 tempest-ServersTestJSON-809132396 tempest-ServersTestJSON-809132396-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:44.606970 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:54:44.640365 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:44.641332 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:44.926899 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:44.927713 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:44.929236 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:44.929977 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:44.973319 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Getting quotas for project 570814d39d4f4bdda9967e16cc01caf7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:54:44.983338 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Getting quotas for user b0ea3170679b4968a96e7682badc2087 and project 570814d39d4f4bdda9967e16cc01caf7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:54:45.002343 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] [instance: ef6ba582-7ca1-4a65-aa58-91710b5285ec] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:54:45.003421 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:45.003882 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:45.226888 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] [instance: ef6ba582-7ca1-4a65-aa58-91710b5285ec] block_device_mapping [BlockDeviceMapping(attachment_id=43d8c36a-71e3-426e-871c-119e67244852,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='81bbc85c-69d3-494e-8b10-e7bb28d50cfd',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=73043b16-2510-42bb-8911-d70655c614cb,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c5e0c6da-9b18-4f96-8357-6061f9e0810d',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=1fa7ecd5-bded-485b-8b5d-6b323237c66f,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a00caeea-b2e3-41ba-a897-b80bc1ea86ad',volume_size=1,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:54:45.229531 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:45.230150 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:45.379768 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:45.380630 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:45.581609 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:45.583622 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:45.953114 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:54:45.954165 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5e7edb2f-2757-42b6-8556-86243b106567 tempest-TaggedBootDevicesTest-477264339 tempest-TaggedBootDevicesTest-477264339-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:54:56.035262 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:54:57.384010 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:54:58.425393 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48584. May 19 14:55:22.516939 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 14:55:22.583703 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:55:22.584118 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:55:22.874064 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:55:22.878388 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:55:22.888958 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:55:22.889572 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:55:22.966622 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Getting quotas for project 9f644a3e68b544f5bad95f7332c34d9f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 14:55:22.976167 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Getting quotas for user 753d464730314d9b884655098dbf6d55 and project 9f644a3e68b544f5bad95f7332c34d9f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 14:55:23.023233 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] [instance: 362c33f8-0f90-4140-9f78-0e3010d893bf] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 14:55:23.031031 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:55:23.031748 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:55:23.151662 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] [instance: 362c33f8-0f90-4140-9f78-0e3010d893bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 14:55:23.153468 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:55:23.154263 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:55:23.585576 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 14:55:23.586556 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-fde6e440-a94d-4bc7-b6f4-488936c6e935 tempest-AttachVolumeTestJSON-783252833 tempest-AttachVolumeTestJSON-783252833-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 14:55:25.796223 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:55:26.845614 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49020. May 19 14:57:10.966731 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:57:28.529642 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:57:28.577165 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:57:29.585142 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51918. May 19 14:57:29.678511 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51920. May 19 14:57:39.223263 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:57:40.265715 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52120. May 19 14:57:44.013562 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:57:45.060048 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52234. May 19 14:57:58.418910 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:57:59.452334 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52846. May 19 14:58:16.059569 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:58:26.842213 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 14:58:27.892825 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53378. May 19 15:00:29.569815 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:00:29.631488 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:00:30.616938 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57036. May 19 15:00:30.732069 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57040. May 19 15:00:30.994333 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:00:38.219555 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:00:40.265444 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:00:41.140357 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:00:41.299498 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57278. May 19 15:00:44.074441 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:00:45.059899 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:00:46.082631 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57396. May 19 15:00:46.298710 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:00:55.182501 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Took 1.56 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:00:55.254395 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:00:55.255715 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:00:55.710893 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:00:55.711295 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:00:55.712018 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:00:55.712402 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:00:55.753715 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Getting quotas for project 976a9fa81d824a8b99c18d2e9513ffeb. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:00:55.766617 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Getting quotas for user dccf8fa8bfce4de1a414b532bf12eb53 and project 976a9fa81d824a8b99c18d2e9513ffeb. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:00:55.795779 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] [instance: 6b10b3be-1d20-4514-8321-2c8d9b62ab0b] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:00:55.796636 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:00:55.797007 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:00:55.971808 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] [instance: 6b10b3be-1d20-4514-8321-2c8d9b62ab0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:00:55.973086 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:00:55.973526 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:00:56.419484 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:00:56.420745 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-498b81bb-b20b-4750-b758-bf414df4e48b tempest-VolumesActionsTest-744725399 tempest-VolumesActionsTest-744725399-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:00:59.453421 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:01:00.481097 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57742. May 19 15:01:27.897472 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:01:28.914084 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58428. May 19 15:01:36.092375 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:02:58.698393 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Took 1.44 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:02:58.846614 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:02:58.847336 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:02:59.281533 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:02:59.290037 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:02:59.292394 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:02:59.293031 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:02:59.415154 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Getting quotas for project 9fe480cce9ba4c01819970ef904d8b41. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:02:59.447159 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Getting quotas for user f43d8c9c16f641eea0b9674fc83fd0c9 and project 9fe480cce9ba4c01819970ef904d8b41. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:02:59.504254 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] [instance: e14e88ee-2147-4469-b34c-0815165b4fe5] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:02:59.508367 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:02:59.508928 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:02:59.618317 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] [instance: e14e88ee-2147-4469-b34c-0815165b4fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:02:59.620741 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:02:59.621687 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:03:00.066274 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:03:00.066274 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3b4d06bc-1a00-4f10-8ddd-9be03757ab91 tempest-VolumesNegativeTest-1493627681 tempest-VolumesNegativeTest-1493627681-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:03:30.596084 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:03:31.648504 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33336. May 19 15:03:41.299696 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:03:42.350152 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33694. May 19 15:03:51.036018 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:03:54.237328 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:03:54.284842 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:03:54.285448 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:03:54.601736 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:03:54.604217 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:03:54.605830 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:03:54.606902 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:03:54.652795 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Getting quotas for project 62406876c19c4f9ab44960af1e62d790. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:03:54.666949 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Getting quotas for user eeeffb2d00314c4788bb456a94eba620 and project 62406876c19c4f9ab44960af1e62d790. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:03:54.701922 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] [instance: 08b21310-1ab9-44cd-99ae-24206da0ed7c] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:03:54.702952 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:03:54.703487 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:03:54.794664 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] [instance: 08b21310-1ab9-44cd-99ae-24206da0ed7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:03:54.796222 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:03:54.796634 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:03:55.093097 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:03:55.094245 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d4250635-8bb3-420a-a90e-9be8f48c86ff tempest-TestServerAdvancedOps-1522362738 tempest-TestServerAdvancedOps-1522362738-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:03:58.246851 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:04:00.480994 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:04:01.182770 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:04:01.511092 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34054. May 19 15:04:28.915664 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:04:29.953425 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34600. May 19 15:04:31.130282 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Took 1.06 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:04:31.161629 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:31.162347 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:31.608700 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:31.609505 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:31.611194 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:31.611856 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:31.651492 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Getting quotas for project d1c62806f4e940479ed569a1193c92f2. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:04:31.683237 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Getting quotas for user 542b6621e7bc46ad93661c1bffbde1dd and project d1c62806f4e940479ed569a1193c92f2. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:04:31.726515 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] [instance: 58b26424-f4a4-4cdf-a86a-7a65af5c1ba2] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:04:31.728808 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:31.729788 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:31.846072 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] [instance: 58b26424-f4a4-4cdf-a86a-7a65af5c1ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:04:31.847486 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:31.847933 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:32.234475 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:32.235631 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-936582b6-e198-4b97-a52f-4ac3b36d1515 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:54.369217 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:04:54.410289 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:54.413807 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:54.748691 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:54.749319 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:54.750696 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:54.751754 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:54.792371 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Getting quotas for project 37af1f24c2db48a0a05e751664f65053. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:04:54.802275 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Getting quotas for user 25efd08d34bb41fa9470f812b03861d1 and project 37af1f24c2db48a0a05e751664f65053. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:04:54.823615 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] [instance: e9107118-f41c-4677-9e8d-4856f0a5785e] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:04:54.825546 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:54.826520 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:54.937744 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] [instance: e9107118-f41c-4677-9e8d-4856f0a5785e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:04:54.940573 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:54.941304 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:55.302139 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:04:55.302563 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f11dfe2a-863b-4906-8fdc-157017ef0b58 tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:04:56.116585 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:06:01.154539 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Took 1.39 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:06:01.210560 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:01.211658 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:01.471045 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:01.471958 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:01.472936 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:01.482682 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:01.516238 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Getting quotas for project e0542660c5e04805a181ae185d4cd0ec. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:06:01.529907 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Getting quotas for user 8b4d5ebfdb4a46f0a3b409b39a9851d0 and project e0542660c5e04805a181ae185d4cd0ec. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:06:01.551449 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] [instance: 23e5f437-1d6a-4181-97ce-78459469e1c1] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:06:01.553401 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:01.554384 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:01.667781 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] [instance: 23e5f437-1d6a-4181-97ce-78459469e1c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:06:01.672527 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:01.672527 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:01.992252 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:01.993120 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-df68f636-86ec-4288-a40c-cc810ad4d701 tempest-VolumesBackupsTest-842339974 tempest-VolumesBackupsTest-842339974-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:07.403393 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-5e45cf9c-b069-44f4-b986-9fb8448b5c39 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:06:07.410131 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5e45cf9c-b069-44f4-b986-9fb8448b5c39 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:07.410683 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5e45cf9c-b069-44f4-b986-9fb8448b5c39 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:08.581208 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-5e45cf9c-b069-44f4-b986-9fb8448b5c39 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] [instance: 58b26424-f4a4-4cdf-a86a-7a65af5c1ba2] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99477) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 15:06:09.388062 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-5e45cf9c-b069-44f4-b986-9fb8448b5c39 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Created allocations for migration beb77b07-6188-466a-a5ed-28c455c82449 on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99477) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:06:09.644754 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:06:09.714447 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:09.715006 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:09.855372 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:09.855866 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:09.857098 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:09.857625 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:09.883246 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Getting quotas for project 37af1f24c2db48a0a05e751664f65053. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:06:09.889560 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Getting quotas for user 25efd08d34bb41fa9470f812b03861d1 and project 37af1f24c2db48a0a05e751664f65053. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:06:09.906398 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] [instance: b4c1ff27-2f01-4d78-959a-926586358dff] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:06:09.907754 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:09.918826 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:10.014208 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] [instance: b4c1ff27-2f01-4d78-959a-926586358dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:06:10.015684 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:10.016161 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:10.068051 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-5e45cf9c-b069-44f4-b986-9fb8448b5c39 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] [instance: 58b26424-f4a4-4cdf-a86a-7a65af5c1ba2] Calling prep_resize with selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99477) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 15:06:10.488986 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:10.489872 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-65ca91e4-bfc8-4b8e-9d96-05a3b6b6477e tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:22.590745 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:06:22.614432 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:22.614840 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:22.913593 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:22.914108 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:22.915195 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:22.915583 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:22.939376 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Getting quotas for project daffd5f58acc48c884edfacd0f326e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:06:22.945140 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Getting quotas for user 6eab89f0e7e4499a9b1c4759c77581e6 and project daffd5f58acc48c884edfacd0f326e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:06:22.957564 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] [instance: 713966ca-5b4b-4f37-bf19-7576b068e41e] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:06:22.958597 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:22.958998 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:23.063496 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] [instance: 713966ca-5b4b-4f37-bf19-7576b068e41e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:06:23.065730 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:23.066294 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:23.351215 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:23.352230 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-5d99dcef-4a80-4293-bcfe-8cb5ac33bf6e tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:43.922060 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f4885144-da8c-41a2-8ac7-7337211c10f2 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method rebuild_instance {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:06:43.928755 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f4885144-da8c-41a2-8ac7-7337211c10f2 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:06:43.928755 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f4885144-da8c-41a2-8ac7-7337211c10f2 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:06:44.041955 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f4885144-da8c-41a2-8ac7-7337211c10f2 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] [instance: 713966ca-5b4b-4f37-bf19-7576b068e41e] No migration record for the rebuild/evacuate request. {{(pid=99476) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 19 15:07:01.509377 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:07:02.527704 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36618. May 19 15:07:11.062287 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:07:28.602985 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:07:28.662158 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:28.663741 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:28.846677 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:28.847277 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:28.848017 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:28.848576 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:28.866434 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Getting quotas for project daffd5f58acc48c884edfacd0f326e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:07:28.871688 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Getting quotas for user 6eab89f0e7e4499a9b1c4759c77581e6 and project daffd5f58acc48c884edfacd0f326e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:07:28.883327 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] [instance: 9fcbd768-6226-4bc1-a1e0-510552d22b87] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:07:28.884243 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:28.884796 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:28.938682 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] [instance: 9fcbd768-6226-4bc1-a1e0-510552d22b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:07:28.939946 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:28.940356 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:29.230571 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:29.230971 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-abb97cfc-6101-4bb5-98cf-cf833b256685 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:29.949705 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:07:30.974344 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37116. May 19 15:07:53.245276 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ad660c98-c641-43ce-9d60-b7d5980cab05 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method rebuild_instance {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:07:53.245875 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad660c98-c641-43ce-9d60-b7d5980cab05 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:53.246031 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-ad660c98-c641-43ce-9d60-b7d5980cab05 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:53.383784 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-ad660c98-c641-43ce-9d60-b7d5980cab05 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] [instance: 9fcbd768-6226-4bc1-a1e0-510552d22b87] No migration record for the rebuild/evacuate request. {{(pid=99477) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 19 15:07:53.844890 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:07:53.919850 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:53.922863 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:54.117893 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:54.118545 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:54.119991 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:54.120463 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:54.139836 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Getting quotas for project 37af1f24c2db48a0a05e751664f65053. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:07:54.148106 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Getting quotas for user 25efd08d34bb41fa9470f812b03861d1 and project 37af1f24c2db48a0a05e751664f65053. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:07:54.160117 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] [instance: de9a277a-d3f9-4387-8e60-1e975810e91b] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:07:54.161611 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:54.181162 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:54.305229 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] [instance: de9a277a-d3f9-4387-8e60-1e975810e91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:07:54.306977 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:54.307535 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:54.696152 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:54.697047 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-494ac343-5a70-4934-bf26-a662dd460efb tempest-TestNetworkBasicOps-1656471640 tempest-TestNetworkBasicOps-1656471640-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:57.667447 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:07:57.734560 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:57.740034 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:57.894627 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:57.894897 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:57.896460 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:57.897174 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:57.919744 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Getting quotas for project d1c62806f4e940479ed569a1193c92f2. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:07:57.926262 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Getting quotas for user 542b6621e7bc46ad93661c1bffbde1dd and project d1c62806f4e940479ed569a1193c92f2. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:07:57.938774 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] [instance: 3776a47f-8be1-4d92-aab3-a410a4cd0f0e] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:07:57.940100 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:57.941085 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:58.069039 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] [instance: 3776a47f-8be1-4d92-aab3-a410a4cd0f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:07:58.070335 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:58.070743 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:07:58.430723 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:07:58.441043 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-43aed793-4344-4888-976c-8c1dbbd0b62c tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:08:23.852552 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Took 1.04 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:08:23.901267 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:08:23.901917 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:08:24.035377 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:08:24.035787 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:08:24.036630 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:08:24.037029 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:08:24.063669 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Getting quotas for project daffd5f58acc48c884edfacd0f326e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:08:24.069874 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Getting quotas for user 6eab89f0e7e4499a9b1c4759c77581e6 and project daffd5f58acc48c884edfacd0f326e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:08:24.088536 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] [instance: 014b2701-7e28-42aa-91cf-6f344284f6b5] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:08:24.094450 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:08:24.095129 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:08:24.239374 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] [instance: 014b2701-7e28-42aa-91cf-6f344284f6b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:08:24.240713 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:08:24.241112 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:08:24.656270 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:08:24.657020 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-98e0654b-9cd5-4d76-9fff-8c35dc51f155 tempest-ServerDiskConfigTestJSON-281804666 tempest-ServerDiskConfigTestJSON-281804666-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:08:55.660674 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ebb27643-2947-4a9e-8cd4-2f763921f029 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:08:55.662042 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebb27643-2947-4a9e-8cd4-2f763921f029 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:08:55.662695 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebb27643-2947-4a9e-8cd4-2f763921f029 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:08:56.139873 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-ebb27643-2947-4a9e-8cd4-2f763921f029 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] [instance: 3776a47f-8be1-4d92-aab3-a410a4cd0f0e] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99476) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 15:08:57.527327 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-ebb27643-2947-4a9e-8cd4-2f763921f029 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Created allocations for migration bd5e93b0-1cad-4dda-8028-a223271b047b on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:08:58.292844 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-ebb27643-2947-4a9e-8cd4-2f763921f029 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] [instance: 3776a47f-8be1-4d92-aab3-a410a4cd0f0e] Calling prep_resize with selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99476) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 15:09:01.019196 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:01.019196 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:01.848378 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:09:01.878274 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:01.878928 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:02.193254 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:02.194202 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:02.194644 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:02.195089 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:02.216165 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Getting quotas for project 1bb087b329f449799ea2753efed3ca9f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:09:02.221297 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Getting quotas for user 227484093c2542f68092a46df2c0da7c and project 1bb087b329f449799ea2753efed3ca9f. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:09:02.235643 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] [instance: a25ba46e-857b-4379-bfbe-14dbbd685cb6] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:09:02.237101 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:02.237690 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:02.317513 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] [instance: a25ba46e-857b-4379-bfbe-14dbbd685cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:09:02.319646 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:02.319646 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:02.907754 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:02.908265 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-eedfc95e-44d5-4234-8ccf-c4ccb6748506 tempest-ServerGroupTestJSON-1208960036 tempest-ServerGroupTestJSON-1208960036-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:56.139094 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:09:58.181147 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:09:58.276443 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:58.278252 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:58.529041 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:58.529798 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:58.530832 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:58.531397 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:58.550624 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Getting quotas for project 14ae3327d205480c91a688f597e0e95d. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:09:58.557023 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Getting quotas for user df082b8e2fe5465788e862e23fe2018d and project 14ae3327d205480c91a688f597e0e95d. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:09:58.577955 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] [instance: e423ee23-7ab3-41e8-be3f-bbf24416e643] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:09:58.579807 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:58.580491 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:58.928299 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] [instance: e423ee23-7ab3-41e8-be3f-bbf24416e643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:09:58.931107 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:58.931972 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:09:59.390283 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:09:59.391070 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-8fe0433d-e1dd-40b2-a8eb-ac126c4cc1fc tempest-ServerRescueTestJSONUnderV235-201046875 tempest-ServerRescueTestJSONUnderV235-201046875-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:10:02.531991 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:10:03.548392 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40020. May 19 15:10:30.975979 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:10:31.088350 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:10:32.004473 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40420. May 19 15:10:44.070019 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:10:44.135021 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:10:44.135685 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:10:44.361466 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:10:44.364253 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:10:44.366065 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:10:44.367343 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:10:44.409717 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Getting quotas for project 2fa3d059832642258c3331529de11dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:10:44.428011 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Getting quotas for user 1066d47555984d38974b765f6db54dce and project 2fa3d059832642258c3331529de11dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:10:44.451524 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] [instance: b78425dc-bb75-4394-95af-de3fc47627a7] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:10:44.453213 n-d-791503-3 nova-conductor[99477]: DEBUG nova.scheduler.utils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-791503-3']) and/or node ([]) {{(pid=99477) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} May 19 15:10:44.454048 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:10:44.454452 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:10:44.588716 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] [instance: b78425dc-bb75-4394-95af-de3fc47627a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:10:44.590287 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:10:44.590847 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:10:45.028799 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:10:45.029784 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2251c2a2-8716-461a-9364-c8d36c2fa09d tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:18.229301 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:11:18.311581 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:18.311978 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:18.450323 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:18.452491 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:18.452491 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:18.452491 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:18.485923 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Getting quotas for project 2fa3d059832642258c3331529de11dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:11:18.499230 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Getting quotas for user 1066d47555984d38974b765f6db54dce and project 2fa3d059832642258c3331529de11dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:11:18.522588 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] [instance: 255fdde2-0a8c-4e7a-9a95-c46052aff9a1] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:11:18.526351 n-d-791503-3 nova-conductor[99476]: DEBUG nova.scheduler.utils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-791503-3']) and/or node ([]) {{(pid=99476) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} May 19 15:11:18.527211 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:18.527804 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:18.638967 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] [instance: 255fdde2-0a8c-4e7a-9a95-c46052aff9a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:11:18.640528 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:18.641155 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:18.953505 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:18.954283 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6505b427-abf3-4770-8f86-b1760b6e432c tempest-TestServerMultinode-2022872988 tempest-TestServerMultinode-2022872988-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:19.708271 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:11:19.779150 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:19.779802 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:19.949561 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:19.951424 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:19.952742 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:19.953469 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:20.024322 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Getting quotas for project d1c62806f4e940479ed569a1193c92f2. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:11:20.030680 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Getting quotas for user 542b6621e7bc46ad93661c1bffbde1dd and project d1c62806f4e940479ed569a1193c92f2. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:11:20.049320 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] [instance: 0c2a3465-bad6-42fc-a802-6a59437200ba] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:11:20.058724 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:20.058724 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:20.199151 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] [instance: 0c2a3465-bad6-42fc-a802-6a59437200ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:11:20.200639 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:20.201226 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:20.930765 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:20.932620 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-26bee9b2-6033-471e-91a5-566659cb0e69 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:43.230123 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Took 0.99 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:11:43.291833 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:43.292283 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:43.638085 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:43.641710 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:43.641710 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:43.641710 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:43.661828 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Getting quotas for project 49e20d0ad64d40219c827384254489e8. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:11:43.668427 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Getting quotas for user 8eb0d112857a48f6b5f145f9c7c15369 and project 49e20d0ad64d40219c827384254489e8. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:11:43.686019 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] [instance: b7a1c21b-73f2-40cb-96f9-f71df82b73b0] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:11:43.687304 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:43.687725 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:43.781082 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] [instance: b7a1c21b-73f2-40cb-96f9-f71df82b73b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:11:43.782701 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:43.783111 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:44.107517 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:44.107929 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-026561ed-69ed-4f30-8eca-9bcf041c55d8 tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:53.312165 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-832f66c8-438f-4d4b-a6ea-9c50777bd24e tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method rebuild_instance {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:11:53.313122 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-832f66c8-438f-4d4b-a6ea-9c50777bd24e tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:11:53.313955 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-832f66c8-438f-4d4b-a6ea-9c50777bd24e tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:11:53.476073 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-832f66c8-438f-4d4b-a6ea-9c50777bd24e tempest-ServerShowV254Test-649845938 tempest-ServerShowV254Test-649845938-project] [instance: b7a1c21b-73f2-40cb-96f9-f71df82b73b0] No migration record for the rebuild/evacuate request. {{(pid=99477) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 19 15:12:21.641929 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-9edb69c1-ac19-4af9-9a6d-5f58c4329b98 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:12:21.642804 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-9edb69c1-ac19-4af9-9a6d-5f58c4329b98 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:12:21.642804 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-9edb69c1-ac19-4af9-9a6d-5f58c4329b98 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:12:22.753777 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-9edb69c1-ac19-4af9-9a6d-5f58c4329b98 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Created allocations for migration 7b4efe87-1700-4fb6-a3c7-b7b6582fceff on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:12:22.977221 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.live_migrate [None req-9edb69c1-ac19-4af9-9a6d-5f58c4329b98 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] [instance: 0c2a3465-bad6-42fc-a802-6a59437200ba] Requesting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while live migrating {{(pid=99476) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}} May 19 15:12:23.470790 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-9edb69c1-ac19-4af9-9a6d-5f58c4329b98 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Lazy-loading 'resources' on Instance uuid 0c2a3465-bad6-42fc-a802-6a59437200ba {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 15:12:23.476990 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-9edb69c1-ac19-4af9-9a6d-5f58c4329b98 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] Lazy-loading 'pci_requests' on Instance uuid 0c2a3465-bad6-42fc-a802-6a59437200ba {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 15:12:24.602802 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.live_migrate [None req-9edb69c1-ac19-4af9-9a6d-5f58c4329b98 tempest-TestNetworkAdvancedServerOps-334081984 tempest-TestNetworkAdvancedServerOps-334081984-project-admin] [instance: 0c2a3465-bad6-42fc-a802-6a59437200ba] Start binding ports on destination host: n-h1-791503-3 {{(pid=99476) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} May 19 15:12:35.359090 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:12:35.401677 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:12:35.402085 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:12:35.728593 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:12:35.728593 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:12:35.728593 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:12:35.728593 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:12:35.775021 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Getting quotas for project 60880de204e349dd95d81538d37a07fa. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:12:35.786957 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Getting quotas for user e69b8cf4a1cb43fc9f7d2a34a8819285 and project 60880de204e349dd95d81538d37a07fa. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:12:35.809979 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] [instance: 1fac7218-c529-46ef-b133-71b08edef661] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:12:35.812606 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:12:35.813723 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:12:35.898141 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] [instance: 1fac7218-c529-46ef-b133-71b08edef661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:12:35.900649 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:12:35.901334 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:12:36.347659 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:12:36.348080 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-b9b2f299-cdaf-4c0d-8d1c-cc96d88c5947 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:12:43.934351 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-2626bac4-8fce-420c-b50d-ae19a5bc78b6 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method rebuild_instance {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:12:43.939046 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2626bac4-8fce-420c-b50d-ae19a5bc78b6 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:12:43.942471 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-2626bac4-8fce-420c-b50d-ae19a5bc78b6 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:12:44.047785 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-2626bac4-8fce-420c-b50d-ae19a5bc78b6 tempest-ServerShowV257Test-1232763055 tempest-ServerShowV257Test-1232763055-project] [instance: 1fac7218-c529-46ef-b133-71b08edef661] No migration record for the rebuild/evacuate request. {{(pid=99476) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 19 15:13:29.578065 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:13:29.627862 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:13:29.632163 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:13:29.958118 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:13:29.958829 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:13:29.959854 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:13:29.973680 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:13:30.011254 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Getting quotas for project d1c62806f4e940479ed569a1193c92f2. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:13:30.019291 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Getting quotas for user 542b6621e7bc46ad93661c1bffbde1dd and project d1c62806f4e940479ed569a1193c92f2. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:13:30.032674 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] [instance: 2bfe32d2-b7a1-4835-9586-ce124133b662] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:13:30.034490 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:13:30.035404 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:13:30.178867 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] [instance: 2bfe32d2-b7a1-4835-9586-ce124133b662] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:13:30.180119 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:13:30.180518 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:13:30.529668 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:13:30.530080 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-587c8461-82c5-40da-887c-220186a911e7 tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:13:32.004205 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:13:33.029995 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44334. May 19 15:14:42.356466 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:14:43.392772 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46918. May 19 15:14:52.405843 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-a4ef71d2-2df6-4b5d-828c-dc037384ed5f tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method rebuild_instance {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:14:52.405843 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-a4ef71d2-2df6-4b5d-828c-dc037384ed5f tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:14:52.405843 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-a4ef71d2-2df6-4b5d-828c-dc037384ed5f tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:14:52.521899 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-a4ef71d2-2df6-4b5d-828c-dc037384ed5f tempest-TestNetworkAdvancedServerOps-1019079662 tempest-TestNetworkAdvancedServerOps-1019079662-project] [instance: 2bfe32d2-b7a1-4835-9586-ce124133b662] No migration record for the rebuild/evacuate request. {{(pid=99476) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} May 19 15:15:03.553063 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:15:04.582555 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 47628. May 19 15:15:30.721155 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:15:31.757944 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48054. May 19 15:15:38.275899 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:15:44.126145 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:15:44.482855 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Took 0.99 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:15:44.509203 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:15:44.511152 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:15:44.925372 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:15:44.925929 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:15:44.926577 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:15:44.926972 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:15:44.946135 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Getting quotas for project 006f40f47b384fd8a5d911621d80e5b8. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:15:44.951035 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Getting quotas for user 4e52b0eeb0cd4ba9a7ca951d0ec2c1c4 and project 006f40f47b384fd8a5d911621d80e5b8. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:15:44.965466 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] [instance: b693e858-6dbf-4db4-a25e-f17b111e4d4f] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:15:44.966435 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:15:44.966843 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:15:45.107282 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] [instance: b693e858-6dbf-4db4-a25e-f17b111e4d4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:15:45.109163 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:15:45.109682 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:15:45.570117 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:15:45.572225 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-909a7038-6b59-4dc8-bb50-6b6d31d510e8 tempest-TestServerBasicOps-1758542618 tempest-TestServerBasicOps-1758542618-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:15:46.095312 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:15:46.330630 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:15:47.112233 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48732. May 19 15:16:14.157522 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:16:14.191300 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:16:14.191697 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:16:14.458221 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:16:14.464670 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:16:14.464670 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:16:14.464670 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:16:14.482002 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Getting quotas for project aff69159cabe47318ca7c9eeba31cd21. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:16:14.487003 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Getting quotas for user 5643060b250b4ab19a80534b5379db07 and project aff69159cabe47318ca7c9eeba31cd21. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:16:14.501626 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] [instance: 52f66c74-4db2-4ad5-9ccf-f9985b363522] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:16:14.510746 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:16:14.510746 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:16:14.655385 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] [instance: 52f66c74-4db2-4ad5-9ccf-f9985b363522] block_device_mapping [BlockDeviceMapping(attachment_id=0a460ca2-eeea-4684-95b9-96859900c874,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c951f42-a33a-49a4-8040-92af48f0ef22',volume_size=1,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:16:14.657044 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:16:14.657792 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:16:14.935170 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:16:14.935559 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1e248e16-ee76-4a1f-9a47-a7e3498211c9 tempest-TestVolumeBackupRestore-1070895187 tempest-TestVolumeBackupRestore-1070895187-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:16:33.028410 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:16:34.054332 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 49666. May 19 15:17:10.177035 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:17:10.205487 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:10.206065 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:10.433827 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:10.434482 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:10.435394 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:10.436017 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:10.454973 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:17:10.460105 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for user 275c8e3f8679499cb5fd50dd997ef4a1 and project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:17:10.472147 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: 89cb380e-c473-40c1-b7ef-62acffca4171] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:17:10.473118 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:10.473562 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:10.587795 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: 89cb380e-c473-40c1-b7ef-62acffca4171] block_device_mapping [BlockDeviceMapping(attachment_id=1ad092b9-562a-4e3b-829f-2b7d14b29ba7,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03d26133-e240-4e59-a2f4-29a9e36d6b99',volume_size=1,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:17:10.589333 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:10.589905 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:11.030781 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:11.031105 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-3dc497e1-1671-4cf9-b37a-5c5c9a942f08 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:11.130668 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:17:51.107659 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:17:51.135714 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:51.136115 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:51.358987 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:51.359500 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:51.360317 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:51.360756 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:51.379389 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Getting quotas for project bfba47d8e0d84845aaa92db1982ef4b4. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:17:51.384418 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Getting quotas for user 7578f9af521649f8a85cc150bdb7637e and project bfba47d8e0d84845aaa92db1982ef4b4. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:17:51.399893 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] [instance: e8b79441-9372-4c5d-9a90-9b688cf79b36] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:17:51.401254 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:51.401841 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:51.507387 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] [instance: e8b79441-9372-4c5d-9a90-9b688cf79b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:17:51.509106 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:51.509731 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:17:51.849021 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:17:51.849605 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3a85f67c-e224-403d-a838-3ac29c607828 tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:18:04.583037 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:18:05.603005 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51430. May 19 15:18:21.009028 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:18:21.068036 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:18:21.068766 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:18:21.208430 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:18:21.209060 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:18:21.209924 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:18:21.210500 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:18:21.233389 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:18:21.240621 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for user 275c8e3f8679499cb5fd50dd997ef4a1 and project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:18:21.256324 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: 0feb2e0a-afa9-4429-a307-149a3d0b2e4d] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:18:21.257331 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:18:21.257739 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:18:21.378169 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: 0feb2e0a-afa9-4429-a307-149a3d0b2e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9aff4f30-7ebd-4316-8d94-ed74aaead72f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:18:21.379419 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:18:21.380040 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:18:21.757236 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:18:21.757991 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c1a2690a-3c4d-4548-b6b8-7b187d89a173 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:19:28.805313 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:19:28.827296 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:19:28.827689 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:19:28.973306 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:19:28.973852 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:19:28.974745 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:19:28.975236 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:19:28.991949 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Getting quotas for project bfba47d8e0d84845aaa92db1982ef4b4. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:19:28.997082 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Getting quotas for user 7578f9af521649f8a85cc150bdb7637e and project bfba47d8e0d84845aaa92db1982ef4b4. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:19:29.009142 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] [instance: 1ae36713-65ee-4cea-94f9-77cbe69b9171] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:19:29.010270 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:19:29.010770 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:19:29.085035 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] [instance: 1ae36713-65ee-4cea-94f9-77cbe69b9171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:19:29.086453 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:19:29.086872 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:19:29.291047 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:19:29.291453 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-4e42bc75-63b5-4faf-a6f0-437b3440091e tempest-VolumesSnapshotTestJSON-475737367 tempest-VolumesSnapshotTestJSON-475737367-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:19:34.049466 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:19:35.067537 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52622. May 19 15:19:56.179606 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:20:00.572636 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:20:00.596121 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:00.596532 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:00.721128 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:00.721528 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:00.722468 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:00.722863 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:00.738691 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:20:00.743497 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for user 275c8e3f8679499cb5fd50dd997ef4a1 and project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:20:00.755545 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: 9164e273-958e-43c4-904a-04d6c1b349b2] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:20:00.756649 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:00.756957 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:00.816553 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: 9164e273-958e-43c4-904a-04d6c1b349b2] block_device_mapping [BlockDeviceMapping(attachment_id=00947918-4234-4515-a7a2-f87f18527ea2,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a37e20c3-269f-4232-b134-74c1c532fbe6',volume_size=1,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:20:00.817803 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:00.818202 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:01.004752 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:01.005234 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-752c19ae-a25b-4a28-b8e9-751eb867bfe1 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:28.210355 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:20:28.234921 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:28.235138 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:28.533935 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:28.534276 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:28.534971 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:28.535544 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:28.553824 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:20:28.558872 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for user 275c8e3f8679499cb5fd50dd997ef4a1 and project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:20:28.570853 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: 4640e2be-7406-4230-ac5b-61c9093b6ce8] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:20:28.571827 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:28.572275 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:28.741470 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: 4640e2be-7406-4230-ac5b-61c9093b6ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='053b6da0-3818-42ee-a029-415aab82fe08',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:20:28.743101 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:28.743734 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:29.101217 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:20:29.101599 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-1112b55e-e399-47d6-844f-006738146f34 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:20:31.150537 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:21:05.604105 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:21:06.622983 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53268. May 19 15:21:48.641128 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:21:48.667421 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:21:48.667932 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:21:48.867903 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:21:48.868308 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:21:48.869078 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:21:48.869509 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:21:48.887825 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Getting quotas for project b1f2a54e0b294a18be50505644b90566. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:21:48.892544 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Getting quotas for user 83d37739b7f74a0b8c0936bc5014f0e2 and project b1f2a54e0b294a18be50505644b90566. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:21:48.904390 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] [instance: bf62aa18-c97f-4927-b9e4-39f47dff0413] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:21:48.905405 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:21:48.905798 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:21:48.987800 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] [instance: bf62aa18-c97f-4927-b9e4-39f47dff0413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:21:48.989084 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:21:48.989519 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:21:49.216468 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:21:49.216889 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-edd50c63-e5eb-45ba-a7ad-0afe82d9d2b4 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:26.467625 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:22:26.496813 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:26.497224 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:26.643760 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:26.644159 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:26.644888 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:26.645313 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:26.666413 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:22:26.672501 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for user 275c8e3f8679499cb5fd50dd997ef4a1 and project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:22:26.684494 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: ca089f68-b630-4343-ba85-9303d1f193eb] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:22:26.685471 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:26.685862 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:26.758475 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: ca089f68-b630-4343-ba85-9303d1f193eb] block_device_mapping [BlockDeviceMapping(attachment_id=72bde00a-e192-4f43-81ce-9cb3d241024b,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20a5e550-99cb-44f5-a4b0-71df1ee62ca0',volume_size=1,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:22:26.759720 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:26.760175 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:26.984719 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:26.985252 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1df5f6b-2587-4e5a-a4de-f6050d2d377d tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:35.069423 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:22:36.085487 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53982. May 19 15:22:52.023266 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:22:52.063089 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:52.064833 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:52.267229 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:52.267718 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:52.268650 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:52.269220 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:52.300644 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Getting quotas for project b1f2a54e0b294a18be50505644b90566. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:22:52.308852 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Getting quotas for user 83d37739b7f74a0b8c0936bc5014f0e2 and project b1f2a54e0b294a18be50505644b90566. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:22:52.327205 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] [instance: 4e30a270-0bf3-42d0-837a-533d3420bc80] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:22:52.329473 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:52.330095 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:52.443277 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] [instance: 4e30a270-0bf3-42d0-837a-533d3420bc80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:22:52.444694 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:52.450341 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:22:52.698452 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:22:52.703519 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c5c86f29-626a-4d01-885d-2ebe7227bc42 tempest-TestSecurityGroupsBasicOps-1447726023 tempest-TestSecurityGroupsBasicOps-1447726023-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:23:16.198272 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:23:51.180745 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:24:06.621947 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:24:07.640241 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54270. May 19 15:24:31.758092 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:24:32.799604 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54274. May 19 15:24:47.126998 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:24:48.143777 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54278. May 19 15:25:32.673870 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Took 2.42 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:25:32.696922 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:25:32.697358 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:25:32.826854 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:25:32.827253 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:25:32.827966 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:25:32.828354 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:25:32.843980 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:25:32.848528 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for user 275c8e3f8679499cb5fd50dd997ef4a1 and project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:25:32.861562 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: bf81eb13-9bf8-45cd-a2cb-fca59d4e514f] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:25:32.861562 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:25:32.861562 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:25:32.940595 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: bf81eb13-9bf8-45cd-a2cb-fca59d4e514f] block_device_mapping [BlockDeviceMapping(attachment_id=e96bdac2-7495-4a82-b9fb-7942eb4b77a1,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20a5e550-99cb-44f5-a4b0-71df1ee62ca0',volume_size=1,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:25:32.941859 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:25:32.942263 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:25:33.226619 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:25:33.226960 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:25:33.236990 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [f0027548-7dd5-4cd6-ade6-3ed4ce196adb] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 15:25:34.253730 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [None req-bfeb71d0-8889-4176-8844-5866403d6f40 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [f0027548-7dd5-4cd6-ade6-3ed4ce196adb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54352. May 19 15:25:36.086664 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:25:37.108082 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54360. May 19 15:25:44.158070 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:25:46.354660 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:26:36.217223 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:27:07.640120 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:27:08.656795 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54442. May 19 15:27:11.198729 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:27:31.650686 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:27:32.672900 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54452. May 19 15:27:32.782140 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:27:33.804075 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54454. May 19 15:27:43.401764 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:27:44.417625 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54456. May 19 15:27:48.145338 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:27:49.161753 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54458. May 19 15:28:27.117423 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Took 1.59 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:28:27.142868 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:28:27.143303 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:28:27.289633 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:28:27.290088 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:28:27.291075 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:28:27.291545 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:28:27.313974 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:28:27.319646 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Getting quotas for user 275c8e3f8679499cb5fd50dd997ef4a1 and project 9050aa4a24794776acfe5f66c8547dda. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:28:27.333104 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: b0b6ac1d-502b-4bb7-83ec-25014c718dc3] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:28:27.334112 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:28:27.334513 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:28:27.384961 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] [instance: b0b6ac1d-502b-4bb7-83ec-25014c718dc3] block_device_mapping [BlockDeviceMapping(attachment_id=4c40f345-b72b-4c02-8b85-78fcd98161f2,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e06b1339-6a12-441c-ade2-4d60335618fa',volume_size=1,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:28:27.386521 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:28:27.387111 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:28:27.671107 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:28:27.671726 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a5002e3-9742-403b-9319-ce573c9e87d3 tempest-TestVolumeBootPattern-959933418 tempest-TestVolumeBootPattern-959933418-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:28:37.108496 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:28:38.125809 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54590. May 19 15:29:04.175961 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:29:06.371783 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:29:56.234806 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:30:08.657863 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:30:09.675044 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54650. May 19 15:30:31.216639 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:30:32.668090 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:30:33.690206 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54662. May 19 15:30:33.800113 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:30:34.822579 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54664. May 19 15:30:38.353249 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:30:41.241134 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:30:44.419058 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:30:45.435343 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54686. May 19 15:30:49.163547 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:30:50.179301 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54688. May 19 15:31:38.126854 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:31:39.144109 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54768. May 19 15:32:15.983710 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:32:16.007799 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:16.008268 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:16.196510 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:16.196924 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:16.197708 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:16.198102 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:16.213634 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Getting quotas for project 482c48d1b61d421183e9518b17682777. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:32:16.218288 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Getting quotas for user c74612d6c09b4e92be804b32c17159cf and project 482c48d1b61d421183e9518b17682777. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:32:16.229648 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] [instance: 1245dc78-be03-42cd-91e5-26a5ed84a559] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:32:16.230548 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:16.230953 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:16.293614 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] [instance: 1245dc78-be03-42cd-91e5-26a5ed84a559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:32:16.294876 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:16.295279 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:16.573602 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:16.574050 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f1b5d8f2-27e7-47ee-88aa-1cc490df1f20 tempest-ServersAdminNegativeTestJSON-290802755 tempest-ServersAdminNegativeTestJSON-290802755-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:24.196164 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:32:26.391834 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:32:45.989609 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:32:46.030558 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:46.030871 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:46.247389 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:46.247790 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:46.248527 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:46.249166 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:46.269633 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Getting quotas for project 7f2e3516c98f49a3a46ac80f887c898e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:32:46.274399 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Getting quotas for user 50cac60a29bf4654a407e7ac9688aecf and project 7f2e3516c98f49a3a46ac80f887c898e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:32:46.286385 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] [instance: 0964edca-8c9b-4e57-86f4-0f88c91e57c1] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:32:46.287948 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:46.287948 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:46.378681 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] [instance: 0964edca-8c9b-4e57-86f4-0f88c91e57c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:32:46.380029 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:46.380424 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:32:46.615472 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:32:46.615953 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-f1ca7914-4a4e-4ea3-8c25-b12314897034 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:33:00.611306 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-c6d59ed4-93d4-4492-b2ad-6e87ae7675a1 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:33:00.612321 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c6d59ed4-93d4-4492-b2ad-6e87ae7675a1 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:33:00.612470 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-c6d59ed4-93d4-4492-b2ad-6e87ae7675a1 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:33:01.043212 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-c6d59ed4-93d4-4492-b2ad-6e87ae7675a1 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] [instance: 0964edca-8c9b-4e57-86f4-0f88c91e57c1] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99476) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 15:33:01.593912 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-c6d59ed4-93d4-4492-b2ad-6e87ae7675a1 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] Created allocations for migration f2231b31-0756-4ad5-92ec-5f30aaffa18c on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:33:01.937689 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-c6d59ed4-93d4-4492-b2ad-6e87ae7675a1 tempest-DeleteServersTestJSON-1224887065 tempest-DeleteServersTestJSON-1224887065-project] [instance: 0964edca-8c9b-4e57-86f4-0f88c91e57c1] Calling prep_resize with selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"7df066a6-f733-45d1-9e5a-5ab4cb09500f": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7df066a6-f733-45d1-9e5a-5ab4cb09500f"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=7df066a6-f733-45d1-9e5a-5ab4cb09500f,limits=SchedulerLimits,nodename='n-h1-791503-3',service_host='n-h1-791503-3')] {{(pid=99476) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 15:33:09.677060 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:33:10.694517 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55168. May 19 15:33:16.252279 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:33:40.968202 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:33:40.991094 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:33:40.992775 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:33:41.194573 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:33:41.195502 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:33:41.196233 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:33:41.196625 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:33:41.212589 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Getting quotas for project 166dd7da20b04c5d9485f481336a7196. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:33:41.217071 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Getting quotas for user 581db71067d84ecea661d9e0b498ebbf and project 166dd7da20b04c5d9485f481336a7196. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:33:41.227594 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] [instance: 46148f1a-2663-413e-b326-0a6aea48051a] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:33:41.228509 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:33:41.228900 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:33:41.348949 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] [instance: 46148f1a-2663-413e-b326-0a6aea48051a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:33:41.350224 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:33:41.350616 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:33:41.601716 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:33:41.602116 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-e54d5eaf-a5b7-4348-91c6-4f1143fddbab tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:33:51.235603 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:33:54.955943 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-1a0d582b-f4a7-4c76-8cd9-a384ae3c6601 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:33:54.956512 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a0d582b-f4a7-4c76-8cd9-a384ae3c6601 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:33:54.956825 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-1a0d582b-f4a7-4c76-8cd9-a384ae3c6601 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:33:55.217485 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-1a0d582b-f4a7-4c76-8cd9-a384ae3c6601 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] [instance: 46148f1a-2663-413e-b326-0a6aea48051a] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99476) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 15:33:55.894862 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-1a0d582b-f4a7-4c76-8cd9-a384ae3c6601 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Created allocations for migration 7e85a24a-6f55-47bb-a653-64c594a8d2ee on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:33:56.356770 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-1a0d582b-f4a7-4c76-8cd9-a384ae3c6601 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] [instance: 46148f1a-2663-413e-b326-0a6aea48051a] Calling prep_resize with selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"7df066a6-f733-45d1-9e5a-5ab4cb09500f": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7df066a6-f733-45d1-9e5a-5ab4cb09500f"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=7df066a6-f733-45d1-9e5a-5ab4cb09500f,limits=SchedulerLimits,nodename='n-h1-791503-3',service_host='n-h1-791503-3')] {{(pid=99476) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 15:34:25.634990 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:34:25.657380 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:34:25.657793 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:34:25.792837 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:34:25.793320 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:34:25.794063 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:34:25.794458 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:34:25.812057 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Getting quotas for project 166dd7da20b04c5d9485f481336a7196. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:34:25.817812 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Getting quotas for user 581db71067d84ecea661d9e0b498ebbf and project 166dd7da20b04c5d9485f481336a7196. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:34:25.829964 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] [instance: bede07e2-eef5-4786-89d6-9441097f2550] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:34:25.832468 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:34:25.832468 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:34:25.937871 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] [instance: bede07e2-eef5-4786-89d6-9441097f2550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:34:25.940127 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:34:25.940127 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:34:26.165834 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:34:26.166318 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-6bade80b-ddf7-48fa-b128-c1fe7b9e1052 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:34:39.146612 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:34:40.165576 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55484. May 19 15:34:41.606458 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f8629472-eca1-43e4-bf9e-8fea853ad760 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:34:41.607118 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f8629472-eca1-43e4-bf9e-8fea853ad760 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:34:41.607316 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f8629472-eca1-43e4-bf9e-8fea853ad760 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:34:41.935253 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-f8629472-eca1-43e4-bf9e-8fea853ad760 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] [instance: bede07e2-eef5-4786-89d6-9441097f2550] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99476) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 15:34:42.466191 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-f8629472-eca1-43e4-bf9e-8fea853ad760 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] Created allocations for migration 4ca1fa22-03ec-455b-9052-83dfb40ea72c on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:34:42.875001 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-f8629472-eca1-43e4-bf9e-8fea853ad760 tempest-ServerDiskConfigTestJSON-1373191670 tempest-ServerDiskConfigTestJSON-1373191670-project] [instance: bede07e2-eef5-4786-89d6-9441097f2550] Calling prep_resize with selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"7df066a6-f733-45d1-9e5a-5ab4cb09500f": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7df066a6-f733-45d1-9e5a-5ab4cb09500f"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=7df066a6-f733-45d1-9e5a-5ab4cb09500f,limits=SchedulerLimits,nodename='n-h1-791503-3',service_host='n-h1-791503-3')] {{(pid=99476) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 15:35:45.598665 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:35:45.622436 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:35:45.625059 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:35:45.861286 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:35:45.861678 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:35:45.862409 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:35:45.862805 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:35:45.878915 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Getting quotas for project dec40d6b62014fa6afc638ebbfaa291e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:35:45.883649 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Getting quotas for user 25991e0ee0ea4adba911a19bf192ab0c and project dec40d6b62014fa6afc638ebbfaa291e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:35:45.895177 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 321172ec-d57d-49bd-a3a6-55b3acd05c77] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:35:45.896120 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:35:45.896514 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:35:45.958436 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 321172ec-d57d-49bd-a3a6-55b3acd05c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:35:45.959716 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:35:45.960118 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:35:46.226882 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:35:46.227938 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-45df6189-32d5-45db-a074-37f93166f758 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:36:10.695404 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:36:11.713098 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55768. May 19 15:36:36.269501 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:36:45.439797 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:36:46.456964 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55834. May 19 15:37:11.254074 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:37:33.690100 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:37:34.712018 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55942. May 19 15:37:39.775140 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-3c361ed8-8f9d-47c1-b2bd-4eccfd092ae0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:37:39.775638 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3c361ed8-8f9d-47c1-b2bd-4eccfd092ae0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:37:39.775999 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-3c361ed8-8f9d-47c1-b2bd-4eccfd092ae0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:37:40.113346 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-3c361ed8-8f9d-47c1-b2bd-4eccfd092ae0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 321172ec-d57d-49bd-a3a6-55b3acd05c77] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99477) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 15:37:40.165360 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:37:40.583766 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-3c361ed8-8f9d-47c1-b2bd-4eccfd092ae0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Created allocations for migration be3fe573-990d-4727-8be4-418788e77648 on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99477) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:37:40.929003 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-3c361ed8-8f9d-47c1-b2bd-4eccfd092ae0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 321172ec-d57d-49bd-a3a6-55b3acd05c77] Calling prep_resize with selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"1393a5cf-e110-4cb7-bac4-fa53d5684d2a": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1393a5cf-e110-4cb7-bac4-fa53d5684d2a"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=1393a5cf-e110-4cb7-bac4-fa53d5684d2a,limits=SchedulerLimits,nodename='n-h2-791503-3',service_host='n-h2-791503-3')] {{(pid=99477) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 15:37:41.183320 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 55994. May 19 15:38:13.014432 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:38:13.036559 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:38:13.036974 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:38:13.161741 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:38:13.162146 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:38:13.162889 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:38:13.163279 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:38:13.178721 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Getting quotas for project dec40d6b62014fa6afc638ebbfaa291e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:38:13.183233 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Getting quotas for user 25991e0ee0ea4adba911a19bf192ab0c and project dec40d6b62014fa6afc638ebbfaa291e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:38:13.194260 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 9027fe23-422c-481f-b616-cf0f72d5ef5b] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:38:13.195178 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:38:13.195575 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:38:13.304793 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 9027fe23-422c-481f-b616-cf0f72d5ef5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:38:13.306024 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:38:13.306427 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:38:13.592479 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:38:13.592801 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ae36e53c-4233-4929-af30-98bf690e0302 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:39:11.714936 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:39:12.731514 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56210. May 19 15:39:50.187320 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:39:51.204774 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56282. May 19 15:39:56.287407 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:40:17.903197 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-2eefbb03-d11f-488d-a10f-df3de2d8fd97 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:40:17.903729 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2eefbb03-d11f-488d-a10f-df3de2d8fd97 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:40:17.904072 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-2eefbb03-d11f-488d-a10f-df3de2d8fd97 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:40:18.247473 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-2eefbb03-d11f-488d-a10f-df3de2d8fd97 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 9027fe23-422c-481f-b616-cf0f72d5ef5b] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99477) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 15:40:18.773295 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-2eefbb03-d11f-488d-a10f-df3de2d8fd97 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Created allocations for migration bae17315-311c-4a59-90c4-816e4483e9a6 on 1393a5cf-e110-4cb7-bac4-fa53d5684d2a {{(pid=99477) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:40:19.284860 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-2eefbb03-d11f-488d-a10f-df3de2d8fd97 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 9027fe23-422c-481f-b616-cf0f72d5ef5b] Calling prep_resize with selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"1393a5cf-e110-4cb7-bac4-fa53d5684d2a": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["1393a5cf-e110-4cb7-bac4-fa53d5684d2a"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=1393a5cf-e110-4cb7-bac4-fa53d5684d2a,limits=SchedulerLimits,nodename='n-h2-791503-3',service_host='n-h2-791503-3')] {{(pid=99477) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 15:40:31.271314 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:40:34.709160 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:40:35.740472 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56412. May 19 15:40:38.377618 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:40:41.183158 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:40:41.266369 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:40:42.213164 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56440. May 19 15:40:44.118300 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:40:44.140663 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:40:44.141061 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:40:44.295191 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:40:44.295592 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:40:44.296317 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:40:44.296710 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:40:44.312414 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Getting quotas for project dec40d6b62014fa6afc638ebbfaa291e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:40:44.316990 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Getting quotas for user 25991e0ee0ea4adba911a19bf192ab0c and project dec40d6b62014fa6afc638ebbfaa291e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:40:44.328136 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 7c385466-3bc4-429f-8e52-0ec9406b316e] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:40:44.329062 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:40:44.329492 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:40:44.381616 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 7c385466-3bc4-429f-8e52-0ec9406b316e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:40:44.382928 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:40:44.383326 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:40:44.580498 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:40:44.581003 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-989235cd-7eae-4b1e-a0a1-94e8a2316cd0 tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:40:46.460137 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:40:47.477478 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56478. May 19 15:42:12.733784 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:42:13.752536 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56648. May 19 15:42:51.206432 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:42:52.223267 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56722. May 19 15:43:16.304773 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:43:27.168589 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-e8ee943d-905d-4257-a25f-6f8ffea1f2ec tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:43:27.169382 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e8ee943d-905d-4257-a25f-6f8ffea1f2ec tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:43:27.169652 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-e8ee943d-905d-4257-a25f-6f8ffea1f2ec tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:43:27.639041 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-e8ee943d-905d-4257-a25f-6f8ffea1f2ec tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 7c385466-3bc4-429f-8e52-0ec9406b316e] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99476) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 15:43:28.188011 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-e8ee943d-905d-4257-a25f-6f8ffea1f2ec tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Created allocations for migration fa12c370-0295-474f-876c-43b617b31f3a on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:43:28.675480 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-e8ee943d-905d-4257-a25f-6f8ffea1f2ec tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 7c385466-3bc4-429f-8e52-0ec9406b316e] Calling prep_resize with selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"7df066a6-f733-45d1-9e5a-5ab4cb09500f": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7df066a6-f733-45d1-9e5a-5ab4cb09500f"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=7df066a6-f733-45d1-9e5a-5ab4cb09500f,limits=SchedulerLimits,nodename='n-h1-791503-3',service_host='n-h1-791503-3')] {{(pid=99476) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 15:43:34.828050 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:43:35.850632 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56840. May 19 15:43:42.213948 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:43:43.230457 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56858. May 19 15:43:51.290239 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:44:07.733363 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:44:07.756030 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:44:07.756439 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:44:07.863180 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:44:07.863590 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:44:07.864336 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:44:07.864728 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:44:07.880372 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Getting quotas for project dec40d6b62014fa6afc638ebbfaa291e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:44:07.884830 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Getting quotas for user 25991e0ee0ea4adba911a19bf192ab0c and project dec40d6b62014fa6afc638ebbfaa291e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:44:07.895634 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 3532e138-d40d-40d6-9f3a-46cb4aea3b41] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:44:07.896552 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:44:07.896970 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:44:07.949250 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 3532e138-d40d-40d6-9f3a-46cb4aea3b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:44:07.950548 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:44:07.950942 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:44:08.103994 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:44:08.104326 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-50c54647-d577-43db-9a59-e9f2c0e6724c tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:45:13.751924 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:45:14.768953 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57088. May 19 15:45:44.224047 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:45:46.421112 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:45:52.225782 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:45:53.243442 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57172. May 19 15:46:35.735077 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:46:35.846234 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:46:36.321769 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:46:36.757911 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57258. May 19 15:46:36.869403 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57260. May 19 15:46:43.231069 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:46:44.247548 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57280. May 19 15:46:47.481934 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:46:48.498389 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57290. May 19 15:47:06.981936 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 15:47:06.982589 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:47:06.983118 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:47:07.264697 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 3532e138-d40d-40d6-9f3a-46cb4aea3b41] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99476) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 15:47:07.769592 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] Created allocations for migration 6c670490-5461-4cfb-abda-9d4a3eb9d21b on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99476) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 15:47:07.775729 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [9f98c8e4-1fd7-4463-8f6a-62e7597d1031] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 15:47:08.791961 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [9f98c8e4-1fd7-4463-8f6a-62e7597d1031] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57368. May 19 15:47:11.183989 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.tasks.migrate [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [instance: 3532e138-d40d-40d6-9f3a-46cb4aea3b41] Calling prep_resize with selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"7df066a6-f733-45d1-9e5a-5ab4cb09500f": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7df066a6-f733-45d1-9e5a-5ab4cb09500f"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=7df066a6-f733-45d1-9e5a-5ab4cb09500f,limits=SchedulerLimits,nodename='n-h1-791503-3',service_host='n-h1-791503-3')] {{(pid=99476) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 15:47:11.193798 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [f0027548-7dd5-4cd6-ade6-3ed4ce196adb] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 15:47:11.308924 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:47:12.211606 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [None req-892c35cb-2eea-423f-a785-76ec1e4cc9ad tempest-ServerActionsTestJSON-887351606 tempest-ServerActionsTestJSON-887351606-project] [f0027548-7dd5-4cd6-ade6-3ed4ce196adb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57388. May 19 15:48:14.773364 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:48:15.794881 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57528. May 19 15:48:37.980955 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:48:38.005520 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:38.005917 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:38.172228 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:38.172626 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:38.173391 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:38.173773 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:38.190394 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Getting quotas for project 87cef006f5614895ae7b8028ab84d59e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:48:38.194996 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Getting quotas for user cdd80100334642298292c18400283243 and project 87cef006f5614895ae7b8028ab84d59e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:48:38.206567 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] [instance: f343c2d9-be6a-4f04-b6b6-a7536746700a] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:48:38.207556 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:38.207986 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:38.270827 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] [instance: f343c2d9-be6a-4f04-b6b6-a7536746700a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:48:38.272095 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:38.272480 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:38.585571 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:38.585976 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-513322be-d724-411a-a067-d2b1052b5cb3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:54.271842 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:48:54.295792 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:54.296200 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:54.435516 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:54.435908 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:54.436716 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:54.437099 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:54.454386 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Getting quotas for project 87cef006f5614895ae7b8028ab84d59e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:48:54.459343 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Getting quotas for user cdd80100334642298292c18400283243 and project 87cef006f5614895ae7b8028ab84d59e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:48:54.470986 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] [instance: 7e787b49-fc6b-48c1-a5ca-9dd0e8f730bb] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:48:54.471974 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:54.472375 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:54.533098 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] [instance: 7e787b49-fc6b-48c1-a5ca-9dd0e8f730bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:48:54.534362 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:54.534764 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:48:54.755758 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:48:54.756168 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-45816b42-ec3d-4070-ba96-52cb0fcf57f3 tempest-ServersNegativeTestJSON-189506416 tempest-ServersNegativeTestJSON-189506416-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:49:44.248921 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:49:45.264641 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57990. May 19 15:49:56.339270 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:50:14.129734 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:50:14.151994 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:50:14.152419 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:50:14.312862 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:50:14.313289 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:50:14.314016 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:50:14.314405 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:50:14.329873 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Getting quotas for project 8feaf0eb10da4058af25b0a24f6d40b7. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:50:14.338657 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Getting quotas for user db3db9b58fbf4a1dbeeb38e68b13c51c and project 8feaf0eb10da4058af25b0a24f6d40b7. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:50:14.345518 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] [instance: 65577e4b-4c50-4c0b-b87a-14a68d24438d] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:50:14.346445 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:50:14.346839 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:50:14.427812 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] [instance: 65577e4b-4c50-4c0b-b87a-14a68d24438d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:50:14.429075 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:50:14.429508 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:50:14.639893 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:50:14.640302 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-c88dd6c5-4aeb-4f67-baf3-cf8b8286a636 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:50:31.327683 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:51:00.220481 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:51:00.243553 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:51:00.243949 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:51:00.346284 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:51:00.346691 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:51:00.347683 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:51:00.348075 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:51:00.363566 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Getting quotas for project 8feaf0eb10da4058af25b0a24f6d40b7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:51:00.369221 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Getting quotas for user db3db9b58fbf4a1dbeeb38e68b13c51c and project 8feaf0eb10da4058af25b0a24f6d40b7. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:51:00.379483 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] [instance: 4afdea21-8d3f-43ea-ab64-886a911b3952] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:51:00.380399 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:51:00.380807 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:51:00.484490 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] [instance: 4afdea21-8d3f-43ea-ab64-886a911b3952] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:51:00.485693 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:51:00.486094 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:51:00.724218 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:51:00.724616 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-6003e662-f223-4e88-92b3-52c605ae40b3 tempest-TestEncryptedCinderVolumes-1020454455 tempest-TestEncryptedCinderVolumes-1020454455-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:51:15.794915 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:51:16.814206 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58348. May 19 15:52:27.113869 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:52:27.137690 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:52:27.138097 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:52:27.492045 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:52:27.492444 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:52:27.493162 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:52:27.493580 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:52:27.508779 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Getting quotas for project a5e37c8cf8e44721afcf4fc28a6798c1. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:52:27.513394 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Getting quotas for user bdd6f2549da644989ed0400981d64c8d and project a5e37c8cf8e44721afcf4fc28a6798c1. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:52:27.523820 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] [instance: 76e25747-6d61-4996-b2e4-708b7651cfb9] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:52:27.524737 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:52:27.525143 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:52:27.594276 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] [instance: 76e25747-6d61-4996-b2e4-708b7651cfb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='337291df-7a35-4803-9ff8-267bf56191de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:52:27.595921 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:52:27.596381 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:52:27.848377 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:52:27.848781 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-0f2365f7-d06d-47cf-bc0e-0aefcb214a3c tempest-TestMinimumBasicScenario-1195635433 tempest-TestMinimumBasicScenario-1195635433-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:52:45.266948 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:52:46.282600 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58692. May 19 15:53:16.356292 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:53:36.757087 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:53:37.780724 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58830. May 19 15:53:48.504115 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:53:49.520838 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58836. May 19 15:53:51.347479 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:53:58.405057 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:54:01.294603 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:54:16.815342 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:54:17.831162 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58886. May 19 15:54:36.870036 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:54:37.890833 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58892. May 19 15:54:53.249924 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:54:54.266160 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58900. May 19 15:55:44.249731 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:55:46.284054 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:55:46.445306 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:55:47.303995 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59154. May 19 15:55:58.532610 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:55:58.558913 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:55:58.559591 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:55:58.784175 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:55:58.784706 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:55:58.785598 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:55:58.786136 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:55:58.806624 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:55:58.811945 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for user ab8fbf6667c248418d4b86a831b8c986 and project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:55:58.824759 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: 6e76c980-99b9-4cc4-aed4-5c49b152f372] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:55:58.826178 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:55:58.826634 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:55:58.884262 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: 6e76c980-99b9-4cc4-aed4-5c49b152f372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:55:58.889172 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:55:58.889666 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:55:59.278808 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:55:59.279251 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-ebfde353-5cf6-404d-8d4b-a58c37265fae tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:56:36.372618 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:57:11.366314 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:57:17.833377 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:57:18.856764 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59292. May 19 15:57:37.887083 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:57:38.909854 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59398. May 19 15:57:48.807524 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 15:57:48.833403 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:57:48.833880 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:57:48.958475 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:57:48.963714 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:57:48.963714 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:57:48.963714 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:57:48.976242 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 15:57:48.980808 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for user ab8fbf6667c248418d4b86a831b8c986 and project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 15:57:48.992144 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: e422915b-121e-4f71-b9c9-2736437dfac9] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 15:57:48.993098 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:57:48.993525 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:57:49.050343 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: e422915b-121e-4f71-b9c9-2736437dfac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 15:57:49.051590 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:57:49.051986 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:57:49.361982 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 15:57:49.362553 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-41c36f29-e7dc-4a6b-bc2c-907e93902552 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 15:57:54.267132 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:57:55.282956 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59458. May 19 15:58:47.302991 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 15:58:48.319246 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59504. May 19 15:59:04.266936 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:59:06.463047 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:59:49.525170 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 15:59:50.541865 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59554. May 19 15:59:56.396433 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:00:18.864438 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:00:19.875926 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59592. May 19 16:00:31.382980 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:00:37.779193 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:00:38.426554 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:00:38.807403 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59690. May 19 16:00:38.905027 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:00:39.937428 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59704. May 19 16:00:41.313731 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:00:43.261580 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Took 2.46 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 16:00:43.285262 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:00:43.285671 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:00:43.446548 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:00:43.446945 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:00:43.447719 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:00:43.448110 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:00:43.466870 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 16:00:43.471414 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for user ab8fbf6667c248418d4b86a831b8c986 and project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 16:00:43.481504 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: a2a9a49e-5add-48ce-8973-72610bb5b93a] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 16:00:43.482486 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:00:43.482890 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:00:43.558942 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: a2a9a49e-5add-48ce-8973-72610bb5b93a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 16:00:43.560187 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:00:43.560592 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:00:43.799159 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:00:43.799560 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-563daada-77b4-40df-967a-4beecb5b1235 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:00:55.283936 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:00:56.300993 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59764. May 19 16:01:48.319739 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:01:49.337172 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59798. May 19 16:02:01.510141 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-d0b39346-891f-4005-a20e-2787422910fa tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method migrate_server {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 16:02:01.510664 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d0b39346-891f-4005-a20e-2787422910fa tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:02:01.511002 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-d0b39346-891f-4005-a20e-2787422910fa tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:02:01.812371 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-d0b39346-891f-4005-a20e-2787422910fa tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: a2a9a49e-5add-48ce-8973-72610bb5b93a] Restricting to cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) while migrating {{(pid=99477) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} May 19 16:02:02.340577 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-d0b39346-891f-4005-a20e-2787422910fa tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Created allocations for migration 7357eb7d-fa68-49b6-94b8-93a6a60045bb on 7df066a6-f733-45d1-9e5a-5ab4cb09500f {{(pid=99477) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} May 19 16:02:04.812410 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.tasks.migrate [None req-d0b39346-891f-4005-a20e-2787422910fa tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: a2a9a49e-5add-48ce-8973-72610bb5b93a] Calling prep_resize with selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [Selection(allocation_request='{"allocations": {"7df066a6-f733-45d1-9e5a-5ab4cb09500f": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["7df066a6-f733-45d1-9e5a-5ab4cb09500f"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=f1e7cfaa-5900-401e-83bc-f723363fd7e2,compute_node_uuid=7df066a6-f733-45d1-9e5a-5ab4cb09500f,limits=SchedulerLimits,nodename='n-h1-791503-3',service_host='n-h1-791503-3')] {{(pid=99477) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} May 19 16:02:50.543116 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:02:51.560006 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59916. May 19 16:03:16.413844 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:03:19.876684 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:03:20.898107 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60030. May 19 16:03:22.289827 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 16:03:22.319410 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:03:22.319822 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:03:22.438098 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:03:22.438641 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:03:22.439636 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:03:22.440291 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:03:22.458017 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 16:03:22.463076 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for user ab8fbf6667c248418d4b86a831b8c986 and project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 16:03:22.475697 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: 2bb6916e-bb9a-4423-94e4-46fd6b406830] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 16:03:22.476651 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:03:22.477049 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:03:22.544982 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: 2bb6916e-bb9a-4423-94e4-46fd6b406830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 16:03:22.546192 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:03:22.546622 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:03:22.844362 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:03:22.844788 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-85ef7f97-fee0-4307-9c88-16813ea0dfa9 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:03:51.400473 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:04:04.285589 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:04:06.481613 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:04:39.927047 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:04:40.948249 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60130. May 19 16:04:49.338840 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:04:50.354740 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60154. May 19 16:04:56.302021 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:04:57.319441 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60176. May 19 16:05:38.444773 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:05:38.799899 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:05:39.820735 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60200. May 19 16:05:41.333077 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:05:51.562835 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:05:52.580280 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60236. May 19 16:06:10.799120 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Took 2.43 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 16:06:10.822248 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:06:10.822669 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:06:10.940820 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:06:10.941264 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:06:10.941994 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:06:10.942385 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:06:10.957914 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 16:06:10.962310 n-d-791503-3 nova-conductor[99477]: DEBUG nova.quota [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Getting quotas for user ab8fbf6667c248418d4b86a831b8c986 and project f50e38ad0fb24df984604223fb3bc87e. Resources: {'instances', 'ram', 'cores'} {{(pid=99477) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 16:06:10.972953 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: 2689af5e-f0de-49c6-b491-2102af0d0e32] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99477) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 16:06:10.973889 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:06:10.974291 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:06:11.043701 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] [instance: 2689af5e-f0de-49c6-b491-2102af0d0e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99477) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 16:06:11.045010 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:06:11.045402 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:06:11.313776 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:06:11.314094 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-82157d9f-e7db-46c3-a965-ef2c58d48675 tempest-TestNetworkAdvancedServerOps-2042019427 tempest-TestNetworkAdvancedServerOps-2042019427-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:06:20.898821 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:06:21.916411 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60370. May 19 16:06:36.431673 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:07:11.417778 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:07:50.355835 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:07:51.374323 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60542. May 19 16:08:13.717348 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 16:08:13.743135 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:08:13.743541 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:08:13.894836 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:08:13.895195 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:08:13.895922 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:08:13.896312 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:08:13.911701 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Getting quotas for project 8662bbd2928f42c9b6d656cc9e97f624. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 16:08:13.916111 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Getting quotas for user 79e1d85c60a54fe88e4e4d0120cee873 and project 8662bbd2928f42c9b6d656cc9e97f624. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 16:08:13.927545 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [instance: 14ff78d4-7d97-450d-ad9f-09c05471d7da] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 16:08:13.928533 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:08:13.928938 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:08:13.987328 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [instance: 14ff78d4-7d97-450d-ad9f-09c05471d7da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 16:08:13.988546 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:08:13.988964 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:08:14.233203 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:08:14.233629 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-16b5ddc7-2745-4932-addb-992c396ed6c1 tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:08:40.944941 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:08:41.966622 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60716. May 19 16:08:57.320851 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:08:58.337491 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60724. May 19 16:09:04.303057 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:09:06.500539 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:09:21.916811 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:09:22.933138 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60736. May 19 16:09:56.468348 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:10:31.434299 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:10:38.463792 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 19 16:10:39.819052 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:10:40.840795 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60776. May 19 16:10:41.351499 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:10:51.374737 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:10:52.391355 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60792. May 19 16:10:52.583030 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:10:53.600170 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60794. May 19 16:11:28.294273 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-95f2086a-4b7c-45ae-980f-8eacf582a0fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method unshelve_instance {{(pid=99477) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 16:11:28.294865 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-95f2086a-4b7c-45ae-980f-8eacf582a0fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:11:28.295207 n-d-791503-3 nova-conductor[99477]: DEBUG oslo_concurrency.lockutils [None req-95f2086a-4b7c-45ae-980f-8eacf582a0fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:11:28.792373 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-95f2086a-4b7c-45ae-980f-8eacf582a0fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [instance: 14ff78d4-7d97-450d-ad9f-09c05471d7da] Requesting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) during scheduling {{(pid=99477) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 19 16:11:31.311270 n-d-791503-3 nova-conductor[99477]: DEBUG nova.conductor.manager [None req-95f2086a-4b7c-45ae-980f-8eacf582a0fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Took 2.51 seconds to select destinations for 1 instance(s). {{(pid=99477) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 16:11:31.319468 n-d-791503-3 nova-conductor[99477]: DEBUG nova.objects.instance [None req-95f2086a-4b7c-45ae-980f-8eacf582a0fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lazy-loading 'flavor' on Instance uuid 14ff78d4-7d97-450d-ad9f-09c05471d7da {{(pid=99477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 16:12:22.935008 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:12:23.951370 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 32852. May 19 16:13:16.484745 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:13:40.837977 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:13:41.859014 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 32928. May 19 16:13:41.965382 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:13:42.987273 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 32938. May 19 16:13:51.451002 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:13:52.392466 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:13:53.411106 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33036. May 19 16:13:53.601096 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:13:54.618335 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33056. May 19 16:13:58.341175 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:13:58.480591 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:13:59.358773 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33082. May 19 16:14:01.368196 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:14:04.321922 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 19 16:14:05.575012 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Took 1.44 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 16:14:05.597197 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:14:05.601101 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:14:05.696759 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:14:05.697149 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:14:05.697902 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:14:05.698283 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:14:05.715655 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Getting quotas for project 8662bbd2928f42c9b6d656cc9e97f624. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 16:14:05.720837 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Getting quotas for user 79e1d85c60a54fe88e4e4d0120cee873 and project 8662bbd2928f42c9b6d656cc9e97f624. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 16:14:05.731408 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [instance: 3f4303bc-621c-4956-86fc-204d8ed6cbb3] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 16:14:05.732313 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:14:05.732713 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:14:05.795926 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [instance: 3f4303bc-621c-4956-86fc-204d8ed6cbb3] block_device_mapping [BlockDeviceMapping(attachment_id=0c70b725-6228-4879-9c01-c6e93cb081cf,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='00ee828d-8c96-4eab-911d-db1cf59ae9c6',volume_size=1,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 16:14:05.797738 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:14:05.798131 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:14:06.007387 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:14:06.007794 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-f5e40ce1-0745-45c0-bc05-248e95aba7fa tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:14:06.518007 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:15:23.952854 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:15:24.968356 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33210. May 19 16:16:36.501156 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:16:41.854955 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:16:42.876817 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33232. May 19 16:16:42.982903 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:16:44.004059 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33234. May 19 16:16:53.410802 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:16:54.427542 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33238. May 19 16:16:54.619962 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:16:55.638491 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33248. May 19 16:16:59.358881 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:17:00.376093 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33264. May 19 16:17:11.469522 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:17:12.449529 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Targeting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) for conductor method unshelve_instance {{(pid=99476) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} May 19 16:17:12.450030 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:17:12.450471 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:17:12.700899 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [instance: 3f4303bc-621c-4956-86fc-204d8ed6cbb3] Requesting cell f1e7cfaa-5900-401e-83bc-f723363fd7e2(cell1) during scheduling {{(pid=99476) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} May 19 16:17:12.709963 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [9f98c8e4-1fd7-4463-8f6a-62e7597d1031] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 16:17:13.726522 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [9f98c8e4-1fd7-4463-8f6a-62e7597d1031] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33314. May 19 16:17:16.109811 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Took 3.40 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 16:17:16.120322 n-d-791503-3 nova-conductor[99476]: DEBUG nova.objects.instance [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] Lazy-loading 'flavor' on Instance uuid 3f4303bc-621c-4956-86fc-204d8ed6cbb3 {{(pid=99476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 19 16:17:16.174589 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [f0027548-7dd5-4cd6-ade6-3ed4ce196adb] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 16:17:17.189327 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc4b25bd-137b-48fb-8cee-ab26c0371f8c tempest-TestShelveInstance-576316583 tempest-TestShelveInstance-576316583-project] [f0027548-7dd5-4cd6-ade6-3ed4ce196adb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33330. May 19 16:17:24.337825 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:17:26.533588 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:18:24.970337 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:18:25.988712 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33396. May 19 16:19:42.873521 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:19:43.899878 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33538. May 19 16:19:44.001734 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:19:45.028698 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33546. May 19 16:19:54.429016 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:19:55.457705 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33582. May 19 16:19:55.640372 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:19:56.520388 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:19:56.678893 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33586. May 19 16:20:00.379804 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:20:01.410580 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33592. May 19 16:20:07.596266 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 16:20:07.623312 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:20:07.624009 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:20:07.835577 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:20:07.835983 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:20:07.836776 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:20:07.837175 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:20:07.853987 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Getting quotas for project 3e8e7debaa87439eb87c9d9a24945064. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 16:20:07.859467 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Getting quotas for user a95c6198e30746468f00f6d090211969 and project 3e8e7debaa87439eb87c9d9a24945064. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 16:20:07.870558 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] [instance: b37132f1-5bca-4d8b-9c97-fabbeca46969] Selected host: n-h1-791503-3; Selected node: n-h1-791503-3; Alternates: [('n-h2-791503-3', 'n-h2-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 16:20:07.871520 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:20:07.872163 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:20:07.937552 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] [instance: b37132f1-5bca-4d8b-9c97-fabbeca46969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='17dffc5d-4cc0-4132-869c-fa6be7efc0fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 16:20:07.938812 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:20:07.939213 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:20:08.166398 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:20:08.166853 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-b31079eb-14b2-48e2-840f-7ae4a0ea1fce tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:20:31.485879 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:20:44.353782 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:20:46.549715 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:21:25.989158 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:21:27.006084 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33758. May 19 16:22:18.501869 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:22:21.390409 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:22:43.894359 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:22:44.916115 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33798. May 19 16:22:45.021033 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:22:46.046123 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33800. May 19 16:22:55.456918 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:22:56.473348 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33838. May 19 16:22:56.679343 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:22:57.697604 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33846. May 19 16:23:01.408821 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:23:02.437917 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33906. May 19 16:23:14.223697 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=99476) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} May 19 16:23:14.248069 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:23:14.248507 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:23:14.494229 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:23:14.494578 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:23:14.495349 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:23:14.495742 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:23:14.514927 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Getting quotas for project 3e8e7debaa87439eb87c9d9a24945064. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 19 16:23:14.521740 n-d-791503-3 nova-conductor[99476]: DEBUG nova.quota [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Getting quotas for user a95c6198e30746468f00f6d090211969 and project 3e8e7debaa87439eb87c9d9a24945064. Resources: {'instances', 'ram', 'cores'} {{(pid=99476) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 19 16:23:14.531788 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] [instance: 7e2047d4-c644-4a3a-bc76-a0eb9a541eb8] Selected host: n-h2-791503-3; Selected node: n-h2-791503-3; Alternates: [('n-h1-791503-3', 'n-h1-791503-3')] {{(pid=99476) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} May 19 16:23:14.532743 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:23:14.533246 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:23:14.621845 n-d-791503-3 nova-conductor[99476]: DEBUG nova.conductor.manager [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] [instance: 7e2047d4-c644-4a3a-bc76-a0eb9a541eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='562fc3c8-9d7b-41ef-8bb9-2e72fb6fcfa2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99476) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} May 19 16:23:14.623182 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:23:14.623581 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:23:14.976218 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 19 16:23:14.976628 n-d-791503-3 nova-conductor[99476]: DEBUG oslo_concurrency.lockutils [None req-5ac61301-9d4c-4d72-bee1-0b7d6a889dc0 tempest-TestSnapshotPattern-1013674428 tempest-TestSnapshotPattern-1013674428-project] Lock "f1e7cfaa-5900-401e-83bc-f723363fd7e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 19 16:23:16.565488 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:23:51.503936 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:24:04.376381 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:24:06.566793 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:24:27.007561 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:24:28.028460 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34140. May 19 16:25:38.518086 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:25:41.408090 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:25:44.913407 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:25:45.935510 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34370. May 19 16:25:46.041030 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:25:47.067952 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34400. May 19 16:25:56.474566 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:25:57.492752 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34448. May 19 16:25:57.699401 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:25:58.722834 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34454. May 19 16:26:02.438560 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:26:03.458815 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34468. May 19 16:26:36.592980 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:27:11.522111 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:27:24.392792 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:27:26.586550 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:27:28.028409 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:27:29.045402 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34520. May 19 16:28:45.932399 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:28:46.957003 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34528. May 19 16:28:47.063205 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:28:48.088863 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34530. May 19 16:28:57.493513 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:28:58.509784 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34534. May 19 16:28:58.538000 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:28:58.718094 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:28:59.735062 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34544. May 19 16:29:01.434079 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:29:03.459040 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:29:04.477216 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34548. May 19 16:29:56.609677 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:30:29.046645 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:30:30.062653 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34560. May 19 16:30:31.539677 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:30:44.410853 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:30:46.604030 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:31:46.951122 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:31:47.972784 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [12901a1d-8419-4bf5-941f-e14f4da5416d] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34588. May 19 16:31:48.081887 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:31:49.103991 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [79ee5234-6528-4e3c-97c3-71ef9a304369] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34590. May 19 16:31:58.511208 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:31:59.531205 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [b427ed3e-a0be-43f7-8873-9ffd2b7cfeaa] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34592. May 19 16:31:59.738055 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 16:32:00.755404 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [869b5c8f-8a61-4d89-b217-e4affd8db805] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34594. May 19 16:32:04.478331 n-d-791503-3 nova-conductor[99477]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:32:05.495479 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] [cf991cab-19a5-4d18-844a-88a0fafe2042] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34596. May 19 16:32:18.558812 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:32:21.452200 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:33:16.628126 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:33:30.063974 n-d-791503-3 nova-conductor[99476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] AMQP server on 10.222.0.16:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection May 19 16:33:31.081471 n-d-791503-3 nova-conductor[99476]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dc98d60-cbe7-46ea-88bd-4f4d0b649beb] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34620. May 19 16:33:51.555868 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:34:04.429783 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:34:06.620689 n-d-791503-3 nova-conductor[99477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer