-- Logs begin at Fri 2022-05-06 10:55:43 UTC, end at Fri 2022-05-06 13:58:34 UTC. --
May 06 11:36:21.011167 n-d-840842-1 systemd[1]: Started Devstack devstack@n-super-cond.service.
May 06 11:36:24.704606 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_db.sqlalchemy.engines [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
May 06 11:36:24.952205 n-d-840842-1 nova-conductor[93472]: DEBUG nova.context [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac569716-85fb-4a25-8496-76082665ff15(cell1) {{(pid=93472) load_cells /opt/stack/nova/nova/context.py:464}}
May 06 11:36:24.956108 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_concurrency.lockutils [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:36:24.957764 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_concurrency.lockutils [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:36:24.958638 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_concurrency.lockutils [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:36:24.960580 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_concurrency.lockutils [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:36:25.001594 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_db.sqlalchemy.engines [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
May 06 11:36:25.002868 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_db.sqlalchemy.engines [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
May 06 11:36:25.017823 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_concurrency.lockutils [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Acquired lock "singleton_lock" {{(pid=93472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 06 11:36:25.018387 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_concurrency.lockutils [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Releasing lock "singleton_lock" {{(pid=93472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 06 11:36:25.019220 n-d-840842-1 nova-conductor[93472]: INFO oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Starting 2 workers
May 06 11:36:25.023925 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Started child 94343 {{(pid=93472) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 06 11:36:25.029057 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Started child 94344 {{(pid=93472) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 06 11:36:25.030132 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Full set of CONF: {{(pid=93472) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 06 11:36:25.030596 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ******************************************************************************** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 06 11:36:25.030924 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] Configuration options gathered from: {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 06 11:36:25.031322 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 06 11:36:25.031938 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] config files: ['/etc/nova/nova.conf'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 06 11:36:25.032405 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ================================================================================ {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 06 11:36:25.032715 n-d-840842-1 nova-conductor[94343]: INFO nova.service [-] Starting conductor node (version 23.2.1)
May 06 11:36:25.033323 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] allow_resize_to_same_host      = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.033800 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] arq_binding_timeout            = 300 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.034233 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] block_device_allocate_retries  = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.034650 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] block_device_allocate_retries_interval = 3 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.035111 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cert                           = self.pem {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.038197 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute_driver                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.038786 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute_monitors               = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.039250 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] config_dir                     = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.039730 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] config_drive_format            = iso9660 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.040074 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] config_file                    = ['/etc/nova/nova.conf'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.040516 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] config_source                  = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.040922 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] console_host                   = n-d-840842-1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.044686 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] control_exchange               = nova {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.045222 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cpu_allocation_ratio           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.045645 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] daemon                         = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.046133 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] debug                          = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.046553 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] default_access_ip_network_name = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.047022 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] default_availability_zone      = nova {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.047401 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] default_ephemeral_format       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.048040 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.053634 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] default_schedule_zone          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.055089 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] disk_allocation_ratio          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.056914 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] enable_new_services            = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.057598 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] enabled_apis                   = ['osapi_compute'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.058173 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] enabled_ssl_apis               = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.058317 n-d-840842-1 nova-conductor[94344]: INFO nova.service [-] Starting conductor node (version 23.2.1)
May 06 11:36:25.060515 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] flat_injected                  = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.063071 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] force_config_drive             = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.063684 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] force_raw_images               = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.064242 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] graceful_shutdown_timeout      = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.065582 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] heal_instance_info_cache_interval = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.075733 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] host                           = n-d-840842-1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.076435 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] initial_cpu_allocation_ratio   = 16.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.077012 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] initial_disk_allocation_ratio  = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.077667 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] initial_ram_allocation_ratio   = 1.5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.078364 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.078918 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] instance_build_timeout         = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.079443 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] instance_delete_interval       = 300 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.080015 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] instance_format                = [instance: %(uuid)s]  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.080569 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] instance_name_template         = instance-%08x {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.080722 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_db.sqlalchemy.engines [None req-712e6765-5fd3-4948-b607-fc30f148a969 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
May 06 11:36:25.081108 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] instance_usage_audit           = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.081735 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] instance_usage_audit_period    = month {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.082357 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.082995 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.083540 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] internal_service_availability_zone = internal {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.084056 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] key                            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.084605 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] live_migration_retry_count     = 30 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.085343 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] log_config_append              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.085924 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.087556 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] log_dir                        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.088110 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] log_file                       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.089809 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] log_options                    = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.092740 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] log_rotate_interval            = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.092740 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] log_rotate_interval_type       = days {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.092740 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] log_rotation_type              = none {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.092740 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.092740 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.092740 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.093319 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.093319 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.093545 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] long_rpc_timeout               = 1800 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.093932 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] max_concurrent_builds          = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.094331 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] max_concurrent_live_migrations = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.094702 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] max_concurrent_snapshots       = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.095085 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] max_local_block_devices        = 3 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.095477 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] max_logfile_count              = 30 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.095857 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] max_logfile_size_mb            = 200 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.096232 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] maximum_instance_delete_attempts = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.096646 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] metadata_listen                = 0.0.0.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.097166 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] metadata_listen_port           = 8775 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.110016 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] metadata_workers               = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.110548 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] migrate_max_retries            = -1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.111099 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] mkisofs_cmd                    = genisoimage {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.113152 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] my_block_storage_ip            = 10.222.0.41 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.113152 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] my_ip                          = 10.222.0.41 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.113152 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] network_allocate_retries       = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.113152 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.113513 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] osapi_compute_listen           = 0.0.0.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.114362 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] osapi_compute_listen_port      = 8774 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.114362 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] osapi_compute_unique_server_name_scope =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.114556 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] osapi_compute_workers          = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.114846 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] password_length                = 12 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.115214 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] periodic_enable                = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.115597 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] periodic_fuzzy_delay           = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.116016 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] pointer_model                  = usbtablet {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.116442 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] preallocate_images             = none {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.116860 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] publish_errors                 = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.117278 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] pybasedir                      = /opt/stack/nova {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.117547 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_db.sqlalchemy.engines [None req-f0dd2d39-f873-46a5-8559-8e32a7c80394 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
May 06 11:36:25.117663 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ram_allocation_ratio           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.118044 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] rate_limit_burst               = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.118696 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] rate_limit_except_level        = CRITICAL {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.119350 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] rate_limit_interval            = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.119955 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] reboot_timeout                 = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.120601 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] reclaim_instance_interval      = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.121426 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] record                         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.122306 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] report_interval                = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.123018 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] rescue_timeout                 = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.123610 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] reserved_host_cpus             = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.123722 n-d-840842-1 nova-conductor[94343]: DEBUG nova.service [None req-712e6765-5fd3-4948-b607-fc30f148a969 None None] Creating RPC server for service conductor {{(pid=94343) start /opt/stack/nova/nova/service.py:182}}
May 06 11:36:25.124300 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] reserved_host_disk_mb          = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.124855 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] reserved_host_memory_mb        = 512 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.125475 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] reserved_huge_pages            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.126075 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] resize_confirm_window          = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.126680 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] resize_fs_using_block_device   = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.127271 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] resume_guests_state_on_host_boot = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.127872 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.128458 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] rpc_response_timeout           = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.129103 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] run_external_periodic_tasks    = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.129969 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] running_deleted_instance_action = reap {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.130740 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] running_deleted_instance_poll_interval = 1800 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.131510 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] running_deleted_instance_timeout = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.132218 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler_instance_sync_interval = 120 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.132804 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_down_time              = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.133428 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] servicegroup_driver            = db {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.134052 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] shelved_offload_time           = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.134625 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] shelved_poll_interval          = 3600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.134744 n-d-840842-1 nova-conductor[94344]: DEBUG nova.service [None req-f0dd2d39-f873-46a5-8559-8e32a7c80394 None None] Creating RPC server for service conductor {{(pid=94344) start /opt/stack/nova/nova/service.py:182}}
May 06 11:36:25.135336 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] shutdown_timeout               = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.135899 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] source_is_ipv6                 = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.136443 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ssl_only                       = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.137894 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] state_path                     = /opt/stack/data/nova {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.138646 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] sync_power_state_interval      = 600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.139425 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] sync_power_state_pool_size     = 1000 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.140200 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] syslog_log_facility            = LOG_USER {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.140830 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] tempdir                        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.141428 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] timeout_nbd                    = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.142082 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] transport_url                  = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.142674 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] update_resources_interval      = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.143233 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] use_cow_images                 = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.143807 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] use_eventlog                   = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.144355 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] use_journal                    = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.144928 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] use_json                       = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.145527 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] use_rootwrap_daemon            = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.146256 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] use_stderr                     = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.146995 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] use_syslog                     = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.147786 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vcpu_pin_set                   = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.148436 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vif_plugging_is_fatal          = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.149035 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vif_plugging_timeout           = 300 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.149671 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] virt_mkfs                      = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.150224 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] volume_usage_poll_interval     = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.150774 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] watch_log_file                 = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.151375 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] web                            = /usr/share/spice-html5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 06 11:36:25.152069 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_concurrency.disable_process_locking = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.152857 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.153705 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.auth_strategy              = keystone {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.154517 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.compute_link_prefix        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.155195 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.155771 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.dhcp_domain                = novalocal {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.156360 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.enable_instance_password   = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.156926 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.glance_link_prefix         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.157583 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.158222 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.instance_list_cells_batch_strategy = distributed {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.158781 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.instance_list_per_project_cells = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.159434 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.list_records_by_skipping_down_cells = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.160177 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.local_metadata_per_cell    = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.161000 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.max_limit                  = 1000 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.161697 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.metadata_cache_expiration  = 15 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.162282 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.neutron_default_tenant_id  = default {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.162888 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.use_forwarded_for          = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.163442 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.use_neutron_default_nets   = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.164032 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.164595 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.vendordata_dynamic_failure_fatal = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.165184 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.165780 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.166498 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.vendordata_dynamic_targets = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.167240 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.vendordata_jsonfile_path   = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.168028 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.168979 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.backend                  = dogpile.cache.memcached {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.169687 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.backend_argument         = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.170370 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.config_prefix            = cache.oslo {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.170939 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.dead_timeout             = 60.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.171517 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.debug_cache_backend      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.172064 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.enable_retry_client      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.172681 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.enable_socket_keepalive  = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.173390 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.enabled                  = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.174226 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.expiration_time          = 600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.175029 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.hashclient_retry_attempts = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.175779 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.hashclient_retry_delay   = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.176384 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.memcache_dead_retry      = 300 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.176972 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.177607 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.178190 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.memcache_pool_maxsize    = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.178805 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.179531 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.180201 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.memcache_socket_timeout  = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.181054 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.proxies                  = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.181880 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.retry_attempts           = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.182722 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.retry_delay              = 0.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.183431 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.socket_keepalive_count   = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.184093 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.socket_keepalive_idle    = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.184739 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.socket_keepalive_interval = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.185770 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.tls_allowed_ciphers      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.186338 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.tls_cafile               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.186915 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.tls_certfile             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.187701 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.tls_enabled              = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.188482 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cache.tls_keyfile              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.189453 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.auth_section            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.190129 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.auth_type               = password {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.190385 n-d-840842-1 nova-conductor[94344]: DEBUG nova.service [None req-f0dd2d39-f873-46a5-8559-8e32a7c80394 None None] Join ServiceGroup membership for this service conductor {{(pid=94344) start /opt/stack/nova/nova/service.py:199}}
May 06 11:36:25.191028 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.cafile                  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.191796 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.catalog_info            = volumev3::publicURL {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.192435 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.certfile                = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.193161 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.collect_timing          = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.194081 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.cross_az_attach         = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.195177 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.endpoint_template       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.196141 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.http_retries            = 3 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.196984 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.insecure                = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.197903 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.keyfile                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.198661 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.os_region_name          = RegionOne {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.199034 n-d-840842-1 nova-conductor[94344]: DEBUG nova.servicegroup.drivers.db [None req-f0dd2d39-f873-46a5-8559-8e32a7c80394 None None] DB_Driver: join new ServiceGroup member n-d-840842-1 to the conductor group, service = <Service: host=n-d-840842-1, binary=nova-conductor, manager_class_name=nova.conductor.manager.ConductorManager> {{(pid=94344) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 06 11:36:25.199620 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.split_loggers           = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.200321 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cinder.timeout                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.201021 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.201279 n-d-840842-1 nova-conductor[94343]: DEBUG nova.service [None req-712e6765-5fd3-4948-b607-fc30f148a969 None None] Join ServiceGroup membership for this service conductor {{(pid=94343) start /opt/stack/nova/nova/service.py:199}}
May 06 11:36:25.201654 n-d-840842-1 nova-conductor[94343]: DEBUG nova.servicegroup.drivers.db [None req-712e6765-5fd3-4948-b607-fc30f148a969 None None] DB_Driver: join new ServiceGroup member n-d-840842-1 to the conductor group, service = <Service: host=n-d-840842-1, binary=nova-conductor, manager_class_name=nova.conductor.manager.ConductorManager> {{(pid=94343) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 06 11:36:25.202435 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.cpu_dedicated_set      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.203215 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.cpu_shared_set         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.203957 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.image_type_exclude_list = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.204618 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.live_migration_wait_for_vif_plug = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.205312 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.max_concurrent_disk_ops = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.205961 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.max_disk_devices_to_attach = -1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.206627 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.207225 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.resource_provider_association_refresh = 300 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.207856 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] compute.shutdown_retry_interval = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.208561 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] conductor.workers              = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.209405 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] console.allowed_origins        = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.210283 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] console.ssl_ciphers            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.211078 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] console.ssl_minimum_version    = default {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.211723 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] consoleauth.token_ttl          = 600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.212343 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.cafile                  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.212986 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.certfile                = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.213713 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.collect_timing          = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.214273 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.connect_retries         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.214973 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.connect_retry_delay     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.215806 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.endpoint_override       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.216654 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.insecure                = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.217538 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.keyfile                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.218237 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.max_version             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.218910 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.min_version             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.219687 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.region_name             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.220339 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.service_name            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.221024 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.service_type            = accelerator {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.221660 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.split_loggers           = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.222269 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.status_code_retries     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.222909 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.status_code_retry_delay = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.223561 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.timeout                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.224340 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.225069 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] cyborg.version                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.225850 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.connection        = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.226532 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.connection_debug  = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.227129 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.connection_parameters =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.227706 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.connection_recycle_time = 3600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.228261 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.connection_trace  = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.228825 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.max_overflow      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.229401 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.max_pool_size     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.229977 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.max_retries       = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.230551 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.231205 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.pool_timeout      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.231996 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.retry_interval    = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.232722 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.slave_connection  = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.233596 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] api_database.sqlite_synchronous = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.234376 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] devices.enabled_vgpu_types     = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.235181 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.235805 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ephemeral_storage_encryption.enabled = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.236377 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ephemeral_storage_encryption.key_size = 512 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.237047 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.api_servers             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.237643 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.cafile                  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.238232 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.certfile                = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.238810 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.collect_timing          = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.239391 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.connect_retries         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.239962 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.connect_retry_delay     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.240617 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.debug                   = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.241389 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.default_trusted_certificate_ids = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.242167 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.enable_certificate_validation = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.242893 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.enable_rbd_download     = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.243496 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.endpoint_override       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.244100 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.insecure                = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.244680 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.keyfile                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.245282 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.max_version             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.245862 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.min_version             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.246435 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.num_retries             = 3 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.247234 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.rbd_ceph_conf           =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.248003 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.rbd_connect_timeout     = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.248715 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.rbd_pool                =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.249427 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.rbd_user                =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.250008 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.region_name             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.250575 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.service_name            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.251204 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.service_type            = image {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.251773 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.split_loggers           = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.252388 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.status_code_retries     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.252950 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.status_code_retry_delay = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.253529 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.timeout                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.254165 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.254855 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.verify_glance_signatures = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.255621 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] glance.version                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.256407 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] guestfs.debug                  = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.257218 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.config_drive_cdrom      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.257891 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.config_drive_inject_password = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.258498 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.259067 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.enable_instance_metrics_collection = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.259635 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.enable_remotefx         = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.260227 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.instances_path_share    =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.260827 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.iscsi_initiator_list    = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.261572 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.limit_cpu_features      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.262351 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.263153 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.263807 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.power_state_check_timeframe = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.264380 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.power_state_event_polling_interval = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.264981 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.265584 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.use_multipath_io        = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.266156 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.volume_attach_retry_count = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.266744 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.volume_attach_retry_interval = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.267320 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.vswitch_name            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.267995 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.268760 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] mks.enabled                    = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.270366 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.271008 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] image_cache.manager_interval   = 2400 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.271602 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] image_cache.precache_concurrency = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.272200 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] image_cache.remove_unused_base_images = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.272804 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.273441 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.274121 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] image_cache.subdirectory_name  = _base {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.274738 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.api_max_retries         = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.275322 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.api_retry_interval      = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.275918 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.auth_section            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.276481 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.auth_type               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.277087 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.cafile                  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.278179 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.certfile                = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.279068 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.collect_timing          = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.279951 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.connect_retries         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.280851 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.connect_retry_delay     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.281523 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.endpoint_override       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.282130 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.insecure                = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.282781 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.keyfile                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.283372 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.max_version             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.283947 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.min_version             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.284537 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.partition_key           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.285287 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.peer_list               = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.286048 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.region_name             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.286823 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.serial_console_state_timeout = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.287466 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.service_name            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.288091 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.service_type            = baremetal {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.288677 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.split_loggers           = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.289286 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.status_code_retries     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.289852 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.status_code_retry_delay = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.290423 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.timeout                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.291052 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.291616 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ironic.version                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.292272 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.292895 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] key_manager.fixed_key          = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.293730 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.294545 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.barbican_api_version  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.295313 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.barbican_endpoint     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.296111 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.barbican_endpoint_type = public {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.296719 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.cafile                = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.297376 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.certfile              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.297972 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.collect_timing        = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.298553 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.insecure              = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.299115 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.keyfile               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.299714 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.number_of_retries     = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.300294 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.retry_delay           = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.300881 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.split_loggers         = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.301640 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.timeout               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.302425 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.verify_ssl            = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.303176 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] barbican.verify_ssl_path       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.303870 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.approle_role_id          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.304454 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.approle_secret_id        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.305035 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.cafile                   = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.305649 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.certfile                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.306227 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.collect_timing           = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.306807 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.insecure                 = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.307365 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.keyfile                  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.307984 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.kv_mountpoint            = secret {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.308566 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.kv_version               = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.309344 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.root_token_id            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.310491 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.split_loggers            = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.311264 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.ssl_ca_crt_file          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.311864 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.timeout                  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.312450 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.use_ssl                  = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.313072 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.313721 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.cafile                = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.314929 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.certfile              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.315512 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.collect_timing        = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.316112 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.connect_retries       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.316799 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.connect_retry_delay   = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.317634 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.endpoint_override     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.318335 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.insecure              = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.319000 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.keyfile               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.319567 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.max_version           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.320132 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.min_version           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.320664 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.region_name           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.321225 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.service_name          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.321795 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.service_type          = identity {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.322324 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.split_loggers         = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.322839 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.status_code_retries   = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.323376 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.status_code_retry_delay = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.323886 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.timeout               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.324438 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.325247 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] keystone.version               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.326088 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.connection_uri         =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.326862 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.cpu_mode               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.327460 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.cpu_model_extra_flags  = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.328054 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.cpu_models             = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.328603 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.device_detach_attempts = 8 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.329348 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.device_detach_timeout  = 20 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.329895 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.disk_cachemodes        = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.330414 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.disk_prefix            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.330986 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.enabled_perf_events    = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.331513 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.file_backed_memory     = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.332057 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.gid_maps               = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.332651 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.hw_disk_discard        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.333318 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.hw_machine_type        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.334085 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.images_rbd_ceph_conf   =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.334809 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.335389 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.335960 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.images_rbd_glance_store_name =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.336669 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.images_rbd_pool        = rbd {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.337255 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.images_type            = default {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.337767 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.images_volume_group    = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.338322 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.inject_key             = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.338845 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.inject_partition       = -2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.339372 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.inject_password        = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.339905 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.iscsi_iface            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.340677 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.iser_use_multipath     = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.341412 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_bandwidth = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.342158 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_completion_timeout = 800 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.342837 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_downtime = 500 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.343442 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_downtime_delay = 75 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.343976 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_downtime_steps = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.344573 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_inbound_addr = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.345103 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_permit_auto_converge = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.345690 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_permit_post_copy = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.346213 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_scheme  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.346756 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_timeout_action = abort {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.347282 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_tunnelled = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.347801 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_uri     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.348329 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.live_migration_with_native_tls = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.348934 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.max_queues             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.349687 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.mem_stats_period_seconds = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.350389 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.nfs_mount_options      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.351244 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.351817 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.num_aoe_discover_tries = 3 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.352414 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.num_iser_scan_tries    = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.352939 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.num_memory_encrypted_guests = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.353498 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.num_nvme_discover_tries = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.354031 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.num_pcie_ports         = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.354602 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.num_volume_scan_tries  = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.355286 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.pmem_namespaces        = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.355826 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.quobyte_client_cfg     = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.356673 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.357394 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rbd_connect_timeout    = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.358131 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.358808 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.359338 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rbd_secret_uuid        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.359853 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rbd_user               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.360406 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.realtime_scheduler_priority = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.360954 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.remote_filesystem_transport = ssh {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.361510 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rescue_image_id        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.362092 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rescue_kernel_id       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.362612 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rescue_ramdisk_id      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.363239 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.363883 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.rx_queue_size          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.364652 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.smbfs_mount_options    =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.365458 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.365998 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.snapshot_compression   = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.366513 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.snapshot_image_format  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.367148 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.367675 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.sparse_logical_volumes = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.368203 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.swtpm_enabled          = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.368763 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.swtpm_group            = tss {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.369330 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.swtpm_user             = tss {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.369868 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.sysinfo_serial         = unique {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.370535 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.tx_queue_size          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.371319 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.uid_maps               = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.372125 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.use_virtio_for_bridges = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.372834 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.virt_type              = kvm {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.373438 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.volume_clear           = zero {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.373971 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.volume_clear_size      = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.374498 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.volume_use_multipath   = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.375060 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.vzstorage_cache_path   = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.375663 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.376349 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.vzstorage_mount_group  = qemu {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.376998 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.vzstorage_mount_opts   = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.377755 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.378606 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.379362 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.vzstorage_mount_user   = stack {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.379989 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.380630 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.auth_section           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.381187 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.auth_type              = password {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.381743 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.cafile                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.382366 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.certfile               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.382916 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.collect_timing         = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.383444 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.connect_retries        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.383961 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.connect_retry_delay    = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.384546 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.default_floating_pool  = public {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.385293 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.endpoint_override      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.386043 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.extension_sync_interval = 600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.386761 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.http_retries           = 3 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.387499 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.insecure               = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.388044 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.keyfile                = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.388639 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.max_version            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.389268 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.metadata_proxy_shared_secret = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.389867 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.min_version            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.390559 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.ovs_bridge             = br-int {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.391216 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.physnets               = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.391990 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.region_name            = RegionOne {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.392748 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.service_metadata_proxy = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.393493 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.service_name           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.394135 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.service_type           = network {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.394763 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.split_loggers          = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.395412 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.status_code_retries    = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.396056 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.status_code_retry_delay = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.396618 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.timeout                = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.397217 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.397772 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] neutron.version                = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.398396 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] notifications.bdms_in_notifications = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.398988 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] notifications.default_level    = INFO {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.399646 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] notifications.notification_format = unversioned {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.400381 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] notifications.notify_on_state_change = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.401165 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.401890 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] pci.alias                      = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.402528 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] pci.passthrough_whitelist      = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.403211 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.auth_section         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.403857 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.auth_type            = password {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.404414 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.auth_url             = http://10.222.0.41/identity {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.404986 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.cafile               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.405617 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.certfile             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.406246 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.collect_timing       = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.406820 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.connect_retries      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.407470 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.connect_retry_delay  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.408198 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.default_domain_id    = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.408856 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.default_domain_name  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.409462 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.domain_id            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.409981 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.domain_name          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.410584 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.endpoint_override    = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.411178 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.insecure             = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.411794 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.keyfile              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.412388 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.max_version          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.412992 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.min_version          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.413646 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.password             = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.414347 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.project_domain_id    = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.415096 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.project_domain_name  = Default {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.415837 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.project_id           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.416567 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.project_name         = service {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.417216 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.region_name          = RegionOne {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.417814 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.service_name         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.418500 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.service_type         = placement {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.419086 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.split_loggers        = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.419613 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.status_code_retries  = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.420147 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.status_code_retry_delay = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.420669 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.system_scope         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.421278 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.timeout              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.421933 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.trust_id             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.422605 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.user_domain_id       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.423318 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.user_domain_name     = Default {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.423946 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.user_id              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.424516 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.username             = placement {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.425079 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.425679 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] placement.version              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.426262 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] powervm.disk_driver            = localdisk {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.426796 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] powervm.proc_units_factor      = 0.1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.427324 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] powervm.volume_group_name      =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.427883 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.cores                    = 20 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.428429 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.count_usage_from_placement = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.429048 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.429748 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.injected_file_content_bytes = 10240 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.430457 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.injected_file_path_length = 255 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.431097 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.injected_files           = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.431760 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.instances                = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.432326 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.key_pairs                = 100 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.432868 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.metadata_items           = 128 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.433418 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.ram                      = 51200 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.433941 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.recheck_quota            = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.434568 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.server_group_members     = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.435432 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] quota.server_groups            = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.435969 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] rdp.enabled                    = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.436779 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.437376 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.437926 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.438576 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.image_metadata_prefilter = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.439242 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.439950 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.max_attempts         = 3 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.440615 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.max_placement_results = 1000 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.441213 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.441752 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.query_placement_for_availability_zone = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.442286 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.query_placement_for_image_type_support = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.442843 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.443376 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] scheduler.workers              = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.443944 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.444486 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.445044 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.445626 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.446173 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.446819 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.447478 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.448240 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.448939 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.host_subset_size = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.449554 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.image_properties_default_architecture = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.450139 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.450673 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.isolated_hosts = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.451208 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.isolated_images = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.451856 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.max_instances_per_host = 50 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.452407 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.452979 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.453525 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.454149 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.454832 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.455532 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.456140 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.456728 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.track_instance_changes = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.457410 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.457960 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] metrics.required               = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.458503 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] metrics.weight_multiplier      = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.459022 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.459548 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] metrics.weight_setting         = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.460310 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.460886 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] serial_console.enabled         = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.461554 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] serial_console.port_range      = 10000:20000 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.462380 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.463085 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.463729 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] serial_console.serialproxy_port = 6083 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.464286 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.auth_section      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.464824 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.auth_type         = password {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.465516 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.cafile            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.466032 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.certfile          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.466567 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.collect_timing    = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.467084 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.insecure          = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.467596 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.keyfile           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.468139 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.send_service_user_token = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.468727 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.split_loggers     = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.469418 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] service_user.timeout           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.470110 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] spice.agent_enabled            = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.470754 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] spice.enabled                  = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.471554 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] spice.html5proxy_base_url      = http://127.0.0.1:6082/spice_auto.html {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.472230 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.472838 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] spice.html5proxy_port          = 6082 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.473434 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] spice.server_listen            = 127.0.0.1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.473968 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.474531 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] upgrade_levels.baseapi         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.475068 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] upgrade_levels.cert            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.475691 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] upgrade_levels.compute         = auto {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.476346 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] upgrade_levels.conductor       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.477049 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] upgrade_levels.scheduler       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.477712 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vendordata_dynamic_auth.auth_section = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.478324 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vendordata_dynamic_auth.auth_type = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.478843 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vendordata_dynamic_auth.cafile = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.479357 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vendordata_dynamic_auth.certfile = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.479959 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vendordata_dynamic_auth.collect_timing = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.480525 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vendordata_dynamic_auth.insecure = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.481091 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vendordata_dynamic_auth.keyfile = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.481661 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vendordata_dynamic_auth.split_loggers = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.482174 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vendordata_dynamic_auth.timeout = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.482823 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.api_retry_count         = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.483481 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.ca_file                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.484174 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.cache_prefix            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.484851 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.cluster_name            = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.485505 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.connection_pool_size    = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.486153 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.console_delay_seconds   = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.486694 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.datastore_regex         = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.487223 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.host_ip                 = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.487756 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.host_password           = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.488298 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.host_port               = 443 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.488807 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.host_username           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.489352 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.insecure                = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.489861 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.integration_bridge      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.490394 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.maximum_objects         = 100 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.491053 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.pbm_default_policy      = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.491734 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.pbm_enabled             = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.492421 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.pbm_wsdl_location       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.493086 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.493713 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.serial_port_proxy_uri   = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.494256 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.serial_port_service_uri = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.494794 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.task_poll_interval      = 0.5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.495312 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.use_linked_clone        = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.495855 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.vnc_keymap              = en-us {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.496375 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.vnc_port                = 5900 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.496977 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vmware.vnc_port_total          = 10000 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.497595 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.auth_schemes               = ['none'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.498136 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.enabled                    = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.498900 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.novncproxy_base_url        = http://127.0.0.1:6080/vnc_auto.html {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.499444 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.500047 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.novncproxy_port            = 6080 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.500780 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.server_listen              = 127.0.0.1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.501527 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.502174 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.vencrypt_ca_certs          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.502735 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.vencrypt_client_cert       = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.503277 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] vnc.vencrypt_client_key        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.503859 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.disable_fallback_pcpu_query = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.504388 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.disable_group_policy_check_upcall = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.504961 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.505502 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.disable_native_luksv1 = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.506020 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.disable_rootwrap   = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.506650 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.enable_numa_live_migration = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.507344 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.508030 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.508689 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.handle_virt_lifecycle_events = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.509284 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.libvirt_disable_apic = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.509805 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.never_download_image_if_on_rbd = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.510368 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.rbd_volume_local_attach = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.510886 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.511455 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.512010 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.512583 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.client_socket_timeout     = 900 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.513183 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.default_pool_size         = 1000 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.513710 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.keep_alive                = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.514233 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.max_header_line           = 16384 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.514808 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.secure_proxy_ssl_header   = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.515496 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.ssl_ca_file               = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.516228 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.ssl_cert_file             = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.516902 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.ssl_key_file              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.517574 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.tcp_keepidle              = 600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.518207 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.518754 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] zvm.ca_file                    = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.519286 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] zvm.cloud_connector_url        = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.519934 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.520479 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] zvm.reachable_timeout          = 300 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.521055 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.enforce_new_defaults = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.521680 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.enforce_scope      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.522363 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.policy_default_rule = default {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.523122 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.523846 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.policy_file        = policy.yaml {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.524456 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.524993 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.525591 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.526189 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.526717 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.527261 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.527952 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.connection_string     = messaging:// {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.528491 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.enabled               = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.529384 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.es_doc_type           = notification {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.530075 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.es_scroll_size        = 10000 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.530768 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.es_scroll_time        = 2m {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.531419 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.filter_error_trace    = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.531971 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.hmac_keys             = SECRET_KEY {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.532510 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.sentinel_service_name = mymaster {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.533060 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.socket_timeout        = 0.1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.533597 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] profiler.trace_sqlalchemy      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.534184 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.backend               = sqlalchemy {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.534755 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.connection            = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.535292 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.connection_debug      = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.535831 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.connection_parameters =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.536390 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.connection_recycle_time = 3600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.537024 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.connection_trace      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.537746 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.db_inc_retry_interval = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.538404 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.db_max_retries        = 20 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.539013 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.db_max_retry_interval = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.539566 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.db_retry_interval     = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.540101 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.max_overflow          = 50 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.540631 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.max_pool_size         = 5 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.541178 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.max_retries           = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.541711 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.mysql_enable_ndb      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.542260 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.542785 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.pool_timeout          = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.543401 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.retry_interval        = 10 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.544258 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.slave_connection      = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.544950 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.sqlite_synchronous    = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.545599 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.use_db_reconnect      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.546142 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] database.use_tpool             = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.546697 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] remote_debug.host              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.547219 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] remote_debug.port              = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.547787 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.548311 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.548845 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.549404 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.550008 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.550674 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.551420 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.552091 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.552654 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.553216 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.553765 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.554308 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.554844 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.555384 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.555902 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.556444 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.557051 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.557725 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.558427 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.559098 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.559734 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.560582 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.ssl      = False {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.561160 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.561726 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.562275 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.562819 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.563411 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.563938 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_notifications.retry = -1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.564590 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.565405 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_messaging_notifications.transport_url = **** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.566141 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_reports.file_event_handler = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.566713 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.567306 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] oslo_reports.log_dir           = None {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 06 11:36:25.567813 n-d-840842-1 nova-conductor[93472]: DEBUG oslo_service.service [None req-043a0c49-be9a-4d9f-be3a-f2a9a2bc9ead None None] ******************************************************************************** {{(pid=93472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 06 11:39:25.167635 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:39:25.192107 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:39:26.188393 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51822.
May 06 11:39:26.207135 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51824.
May 06 11:42:26.180174 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:42:26.201365 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:42:27.194756 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51888.
May 06 11:42:27.214416 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51890.
May 06 11:45:27.190285 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:45:27.209896 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:45:28.206960 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51982.
May 06 11:45:28.223046 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51984.
May 06 11:48:28.200873 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 11:48:28.218585 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 11:48:29.227147 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 52210.
May 06 11:48:29.235296 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 52212.
May 06 11:49:49.827810 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_db.sqlalchemy.engines [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Parent process 93472 forked (94344) with an open database connection, which is being discarded and recreated. {{(pid=94344) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}}
May 06 11:49:50.654665 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:49:50.725796 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:50.729013 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:50.763021 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_db.sqlalchemy.engines [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
May 06 11:49:50.899605 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:50.901188 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:50.901931 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:50.902467 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:50.929498 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_db.sqlalchemy.engines [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
May 06 11:49:50.960298 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Getting quotas for project 3779fecf142a417fa6bd140b1567c8c7. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:49:50.969210 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Getting quotas for user 572044daaae34106a4280a50ba17bfe1 and project 3779fecf142a417fa6bd140b1567c8c7. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:49:50.981766 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] [instance: d0f6f9ef-ce0d-46ae-919f-8a55e08c3303] Selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [('n-h1-840842-1', 'n-h1-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:49:50.983035 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:50.983708 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:50.997444 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] [instance: d0f6f9ef-ce0d-46ae-919f-8a55e08c3303] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:49:51.000756 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:51.001327 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:51.058726 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:51.059138 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:51.059632 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-61aa4e31-0114-43ec-9df5-a73d2f01db7c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Acquired lock "compute-rpcapi-router" {{(pid=94344) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 06 11:49:51.060853 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a3ac29a7-64ec-4ab1-922a-af99232569a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:51.061325 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a3ac29a7-64ec-4ab1-922a-af99232569a8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:51.062105 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a3ac29a7-64ec-4ab1-922a-af99232569a8 None None] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:51.062958 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a3ac29a7-64ec-4ab1-922a-af99232569a8 None None] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:51.073053 n-d-840842-1 nova-conductor[94344]: INFO nova.compute.rpcapi [None req-a3ac29a7-64ec-4ab1-922a-af99232569a8 None None] Automatically selected compute RPC version 6.0 from minimum service version 56
May 06 11:49:51.073934 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a3ac29a7-64ec-4ab1-922a-af99232569a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=94344) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 06 11:49:52.296321 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_db.sqlalchemy.engines [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Parent process 93472 forked (94343) with an open database connection, which is being discarded and recreated. {{(pid=94343) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}}
May 06 11:49:52.964791 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:49:53.007555 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:53.013766 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:53.045932 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_db.sqlalchemy.engines [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
May 06 11:49:53.140691 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:53.143615 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:53.145436 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:53.146671 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:53.177964 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_db.sqlalchemy.engines [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}}
May 06 11:49:53.224811 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Getting quotas for project 6bdc24e17ded48d6aa6d3fc2390abffe. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:49:53.239510 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Getting quotas for user 979c4e4a9cf14f78b8a1e4ca09c8729c and project 6bdc24e17ded48d6aa6d3fc2390abffe. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:49:53.286192 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] [instance: c87b7027-6df5-4807-85f6-244d0f2f9eaf] Selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:49:53.287733 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:53.288148 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:53.308150 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] [instance: c87b7027-6df5-4807-85f6-244d0f2f9eaf] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:49:53.313963 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:53.315500 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:53.396075 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:53.397446 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:53.398212 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4a739e28-8854-4eb6-a4ff-bb36b9eb6457 tempest-AggregatesAdminTestJSON-183692112 tempest-AggregatesAdminTestJSON-183692112-project] Acquired lock "compute-rpcapi-router" {{(pid=94343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 06 11:49:53.400827 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-62591dbf-7c65-46f7-b99d-06d5b5b1d426 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:53.401503 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-62591dbf-7c65-46f7-b99d-06d5b5b1d426 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:53.402638 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-62591dbf-7c65-46f7-b99d-06d5b5b1d426 None None] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:49:53.404373 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-62591dbf-7c65-46f7-b99d-06d5b5b1d426 None None] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:49:53.424444 n-d-840842-1 nova-conductor[94343]: INFO nova.compute.rpcapi [None req-62591dbf-7c65-46f7-b99d-06d5b5b1d426 None None] Automatically selected compute RPC version 6.0 from minimum service version 56
May 06 11:49:53.430340 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-62591dbf-7c65-46f7-b99d-06d5b5b1d426 None None] Releasing lock "compute-rpcapi-router" {{(pid=94343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 06 11:50:11.478816 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:50:11.531450 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:11.532707 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:11.613058 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:11.613585 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:11.614314 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:11.614845 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:11.638119 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Getting quotas for project cedf1edb0c494f7aa22ef62eb82f609d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:50:11.657738 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Getting quotas for user d9282c2461df4edc8ac633b5d3aba4e1 and project cedf1edb0c494f7aa22ef62eb82f609d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:50:11.674750 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] [instance: 627403ab-9d25-4b4e-bbb0-b0e90cbdd305] Selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [('n-h1-840842-1', 'n-h1-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:50:11.675694 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:11.676096 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:11.698043 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] [instance: 627403ab-9d25-4b4e-bbb0-b0e90cbdd305] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:50:11.699366 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:11.699773 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:11.803796 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:11.804212 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-770406fa-5448-436d-894e-bcabdfe5cedc tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:17.661192 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:50:17.700399 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:17.700399 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:17.869635 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:17.870609 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:17.872904 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:17.876435 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:17.956524 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Getting quotas for project 541732bc553e4358b233e874e799009e. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:50:17.970127 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Getting quotas for user 2366faac39be42d4b0fd46dcf4f752a0 and project 541732bc553e4358b233e874e799009e. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:50:18.013547 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] [instance: dd63e236-24d7-4830-99fe-a7f04509a74f] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:50:18.016040 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:18.016459 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:18.037049 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] [instance: dd63e236-24d7-4830-99fe-a7f04509a74f] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:50:18.039096 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:18.039517 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:18.092596 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:18.093056 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fb23e1be-6881-4236-8f0c-49c2468b8684 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:52.303712 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:50:52.304345 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:52.304658 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:52.950386 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Created allocations for migration 0a02719c-d23b-46b4-a471-c03cb4e94f71 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:50:53.427437 n-d-840842-1 nova-conductor[94344]: DEBUG nova.scheduler.utils [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: dd63e236-24d7-4830-99fe-a7f04509a74f] Instance allocations successfully created on destination node df4c24a4-6db6-4618-b10d-1b3bc259f029: {'allocations': {'df4c24a4-6db6-4618-b10d-1b3bc259f029': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94344) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}}
May 06 11:50:53.428478 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lazy-loading 'resources' on Instance uuid dd63e236-24d7-4830-99fe-a7f04509a74f {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:50:53.434515 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lazy-loading 'pci_requests' on Instance uuid dd63e236-24d7-4830-99fe-a7f04509a74f {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:50:55.016801 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.live_migrate [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: dd63e236-24d7-4830-99fe-a7f04509a74f] Start binding ports on destination host: n-h2-840842-1 {{(pid=94344) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}}
May 06 11:50:55.692835 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:50:55.818819 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:55.821388 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:55.973746 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:55.974142 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:55.975176 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:55.976359 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:56.022408 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Getting quotas for project 3779fecf142a417fa6bd140b1567c8c7. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:50:56.035762 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Getting quotas for user 572044daaae34106a4280a50ba17bfe1 and project 3779fecf142a417fa6bd140b1567c8c7. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:50:56.085364 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] [instance: e97623d2-c478-46ad-9d43-2d54a8270593] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:50:56.086053 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:56.086441 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:56.099145 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] [instance: e97623d2-c478-46ad-9d43-2d54a8270593] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:50:56.100482 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:56.100878 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:56.185343 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:50:56.185936 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f90f73e3-34b7-4cd2-a7bc-3e4a5478fa2c tempest-DeleteServersAdminTestJSON-990537499 tempest-DeleteServersAdminTestJSON-990537499-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:50:57.104509 n-d-840842-1 nova-conductor[94344]: ERROR nova.network.neutron [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: dd63e236-24d7-4830-99fe-a7f04509a74f] Binding failed for port aca38417-1d2e-4b48-a473-334a486cb934 and host n-h2-840842-1. Error: (500 {"NeutronError": {"type": "PortBindingError", "message": "Binding for port aca38417-1d2e-4b48-a473-334a486cb934 on host n-h2-840842-1 could not be created or updated.", "detail": ""}})
May 06 11:50:58.562090 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Created allocations for instance dd63e236-24d7-4830-99fe-a7f04509a74f on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}}
May 06 11:50:58.566340 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Failed to compute_task_migrate_server: Migration pre-check error: Binding failed for port aca38417-1d2e-4b48-a473-334a486cb934, please check neutron logs for more information.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port aca38417-1d2e-4b48-a473-334a486cb934, please check neutron logs for more information.
May 06 11:50:58.568131 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-3a29319b-4e8b-4e62-bbd1-bd3fd3c395e8 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: dd63e236-24d7-4830-99fe-a7f04509a74f] Setting instance to ACTIVE state.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port aca38417-1d2e-4b48-a473-334a486cb934, please check neutron logs for more information.
May 06 11:51:00.266201 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:51:00.275809 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:00.279072 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:01.559216 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Created allocations for migration ef4ced84-336c-4d2c-8c4c-db73bbeec247 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:51:01.821293 n-d-840842-1 nova-conductor[94344]: DEBUG nova.scheduler.utils [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 627403ab-9d25-4b4e-bbb0-b0e90cbdd305] Instance allocations successfully created on destination node df4c24a4-6db6-4618-b10d-1b3bc259f029: {'allocations': {'df4c24a4-6db6-4618-b10d-1b3bc259f029': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94344) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}}
May 06 11:51:01.822385 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lazy-loading 'resources' on Instance uuid 627403ab-9d25-4b4e-bbb0-b0e90cbdd305 {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:51:01.847249 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lazy-loading 'pci_requests' on Instance uuid 627403ab-9d25-4b4e-bbb0-b0e90cbdd305 {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:51:02.316423 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.live_migrate [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 627403ab-9d25-4b4e-bbb0-b0e90cbdd305] Start binding ports on destination host: n-h2-840842-1 {{(pid=94344) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}}
May 06 11:51:04.114043 n-d-840842-1 nova-conductor[94344]: ERROR nova.network.neutron [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 627403ab-9d25-4b4e-bbb0-b0e90cbdd305] Binding failed for port 778dfad4-5af9-46eb-96f6-bbe9b6eded60 and host n-h2-840842-1. Error: (500 {"NeutronError": {"type": "PortBindingError", "message": "Binding for port 778dfad4-5af9-46eb-96f6-bbe9b6eded60 on host n-h2-840842-1 could not be created or updated.", "detail": ""}})
May 06 11:51:04.641738 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Created allocations for instance 627403ab-9d25-4b4e-bbb0-b0e90cbdd305 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}}
May 06 11:51:04.642458 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Failed to compute_task_migrate_server: Migration pre-check error: Binding failed for port 778dfad4-5af9-46eb-96f6-bbe9b6eded60, please check neutron logs for more information.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port 778dfad4-5af9-46eb-96f6-bbe9b6eded60, please check neutron logs for more information.
May 06 11:51:04.643360 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-12aaae55-ab18-4f67-a878-5721f73d624e tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 627403ab-9d25-4b4e-bbb0-b0e90cbdd305] Setting instance to ACTIVE state.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port 778dfad4-5af9-46eb-96f6-bbe9b6eded60, please check neutron logs for more information.
May 06 11:51:05.175969 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:51:05.223778 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:05.231483 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:05.368734 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:05.369168 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:05.379174 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:05.379906 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:05.414283 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Getting quotas for project 541732bc553e4358b233e874e799009e. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:51:05.422206 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Getting quotas for user 2366faac39be42d4b0fd46dcf4f752a0 and project 541732bc553e4358b233e874e799009e. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:51:05.454000 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] [instance: 6a6115a6-594f-4978-99b7-cde9ca2aa0f4] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:51:05.455274 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:05.456998 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:05.478314 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] [instance: 6a6115a6-594f-4978-99b7-cde9ca2aa0f4] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:51:05.479876 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:05.480606 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:05.532225 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:05.533024 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e129a0f5-0960-4b20-a79a-543577007923 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:09.464798 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:51:09.512578 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:09.514159 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:09.675527 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:09.676841 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:09.680706 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:09.683904 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:09.786977 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Getting quotas for project cedf1edb0c494f7aa22ef62eb82f609d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:51:09.808751 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Getting quotas for user d9282c2461df4edc8ac633b5d3aba4e1 and project cedf1edb0c494f7aa22ef62eb82f609d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:51:09.857945 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] [instance: 9b3621b3-b97c-4fd3-8512-dc0caf42e9e7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:51:09.859804 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:09.861798 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:09.881196 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] [instance: 9b3621b3-b97c-4fd3-8512-dc0caf42e9e7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:51:09.899361 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:09.900610 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:09.988254 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:09.989433 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8211bec3-5fec-4ed5-b70e-4b20dae33526 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:23.225825 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:51:23.343151 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:23.345316 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:23.485523 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:23.486107 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:23.487276 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:23.488082 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:23.517682 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Getting quotas for project 036a8cfd5c7c494c9d5ef13cb6e9dc11. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:51:23.524477 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Getting quotas for user 3432fa2a6dd84ef28b76442b6ba2a982 and project 036a8cfd5c7c494c9d5ef13cb6e9dc11. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:51:23.540466 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] [instance: 46c994b5-1dd8-4f5f-be02-81a33fc75fc6] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:51:23.542148 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:23.542787 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:23.555010 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] [instance: 46c994b5-1dd8-4f5f-be02-81a33fc75fc6] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:51:23.556909 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:23.558187 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:23.622450 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:23.623148 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c90b4701-2500-4eb5-ab81-98273cd53124 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:27.544745 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:51:27.571459 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:27.572285 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:27.640070 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:27.640922 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:27.641895 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:27.642443 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:27.662456 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Getting quotas for project 6670c2e82d334398adfe7ef107be12e9. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:51:27.667376 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Getting quotas for user acc85f3bf784467aad65b1a2484775d6 and project 6670c2e82d334398adfe7ef107be12e9. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:51:27.681057 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] [instance: 38de58b8-9752-4480-ae71-bca951736979] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:51:27.682673 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:27.683771 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:27.693508 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] [instance: 38de58b8-9752-4480-ae71-bca951736979] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:51:27.697782 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:27.708117 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:27.779915 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:27.780638 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a016ccab-e667-4f97-9bb5-d9b9c9b16dc6 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:39.935450 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:51:39.937315 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:39.938062 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:41.571005 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Created allocations for migration 6d0f6a4b-3ab2-42bc-aa29-fea1933f4329 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:51:41.806681 n-d-840842-1 nova-conductor[94343]: DEBUG nova.scheduler.utils [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 9b3621b3-b97c-4fd3-8512-dc0caf42e9e7] Instance allocations successfully created on destination node df4c24a4-6db6-4618-b10d-1b3bc259f029: {'allocations': {'df4c24a4-6db6-4618-b10d-1b3bc259f029': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94343) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}}
May 06 11:51:41.807841 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lazy-loading 'resources' on Instance uuid 9b3621b3-b97c-4fd3-8512-dc0caf42e9e7 {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:51:41.816484 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lazy-loading 'pci_requests' on Instance uuid 9b3621b3-b97c-4fd3-8512-dc0caf42e9e7 {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:51:43.001997 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.live_migrate [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 9b3621b3-b97c-4fd3-8512-dc0caf42e9e7] Start binding ports on destination host: n-h2-840842-1 {{(pid=94343) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}}
May 06 11:51:44.248481 n-d-840842-1 nova-conductor[94343]: ERROR nova.network.neutron [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 9b3621b3-b97c-4fd3-8512-dc0caf42e9e7] Binding failed for port 9db95acb-ddea-4210-9ea9-c71b433f008d and host n-h2-840842-1. Error: (500 {"NeutronError": {"type": "PortBindingError", "message": "Binding for port 9db95acb-ddea-4210-9ea9-c71b433f008d on host n-h2-840842-1 could not be created or updated.", "detail": ""}})
May 06 11:51:44.938495 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Created allocations for instance 9b3621b3-b97c-4fd3-8512-dc0caf42e9e7 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}}
May 06 11:51:44.942471 n-d-840842-1 nova-conductor[94343]: WARNING nova.scheduler.utils [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Failed to compute_task_migrate_server: Migration pre-check error: Binding failed for port 9db95acb-ddea-4210-9ea9-c71b433f008d, please check neutron logs for more information.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port 9db95acb-ddea-4210-9ea9-c71b433f008d, please check neutron logs for more information.
May 06 11:51:44.943801 n-d-840842-1 nova-conductor[94343]: WARNING nova.scheduler.utils [None req-342f4b35-91ca-44c0-a29c-f9bf714134f4 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 9b3621b3-b97c-4fd3-8512-dc0caf42e9e7] Setting instance to PAUSED state.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port 9db95acb-ddea-4210-9ea9-c71b433f008d, please check neutron logs for more information.
May 06 11:51:45.523177 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:51:45.524048 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:45.524048 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:45.988018 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Created allocations for migration c69bdbcb-0592-413f-8bd0-0b7a1901ad11 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:51:46.148222 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:51:46.183161 n-d-840842-1 nova-conductor[94344]: DEBUG nova.scheduler.utils [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: 6a6115a6-594f-4978-99b7-cde9ca2aa0f4] Instance allocations successfully created on destination node df4c24a4-6db6-4618-b10d-1b3bc259f029: {'allocations': {'df4c24a4-6db6-4618-b10d-1b3bc259f029': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94344) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}}
May 06 11:51:46.183905 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lazy-loading 'resources' on Instance uuid 6a6115a6-594f-4978-99b7-cde9ca2aa0f4 {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:51:46.191764 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6a6115a6-594f-4978-99b7-cde9ca2aa0f4 {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:51:46.201156 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:46.201669 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:46.299439 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:46.300183 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:46.301777 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:46.302767 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:46.330575 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Getting quotas for project 878e8e4516234336a558a0ed25a850ec. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:51:46.337462 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Getting quotas for user 2da9fe984402490cb5be04771987ded5 and project 878e8e4516234336a558a0ed25a850ec. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:51:46.356993 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] [instance: 196026e8-e544-425b-8fc1-ea4e6bc129a3] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:51:46.358678 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:46.359621 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:46.372596 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] [instance: 196026e8-e544-425b-8fc1-ea4e6bc129a3] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:51:46.375513 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:46.377142 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:46.425908 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:46.426575 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1f854bf9-fa74-42ae-b7f7-f0752d470a6a tempest-ServerDiagnosticsNegativeTest-1902848581 tempest-ServerDiagnosticsNegativeTest-1902848581-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:46.763800 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.live_migrate [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: 6a6115a6-594f-4978-99b7-cde9ca2aa0f4] Start binding ports on destination host: n-h2-840842-1 {{(pid=94344) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}}
May 06 11:51:47.826264 n-d-840842-1 nova-conductor[94344]: ERROR nova.network.neutron [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: 6a6115a6-594f-4978-99b7-cde9ca2aa0f4] Binding failed for port a12d078b-6529-4a68-89a7-bbe5210045bc and host n-h2-840842-1. Error: (500 {"NeutronError": {"type": "PortBindingError", "message": "Binding for port a12d078b-6529-4a68-89a7-bbe5210045bc on host n-h2-840842-1 could not be created or updated.", "detail": ""}})
May 06 11:51:48.274029 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:51:48.337459 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:48.339068 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:48.417213 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:48.418142 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:48.419256 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:48.419858 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:48.443379 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Getting quotas for project 5f98b2506c3f444ebf0a4452b9851d01. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:51:48.450241 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Getting quotas for user 34f488ba1b864dd79f5a997b78c44085 and project 5f98b2506c3f444ebf0a4452b9851d01. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:51:48.465144 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] [instance: 45e4b824-fded-4859-afb1-1a6d61346fc7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:51:48.466561 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:48.467203 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:48.477464 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] [instance: 45e4b824-fded-4859-afb1-1a6d61346fc7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:51:48.479597 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:48.480016 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:48.539680 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:48.540565 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edb232ee-af1b-4d8e-a1a9-9132a13bcd9f tempest-VolumesAdminNegativeTest-204247467 tempest-VolumesAdminNegativeTest-204247467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:48.574021 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Created allocations for instance 6a6115a6-594f-4978-99b7-cde9ca2aa0f4 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}}
May 06 11:51:48.574955 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Failed to compute_task_migrate_server: Migration pre-check error: Binding failed for port a12d078b-6529-4a68-89a7-bbe5210045bc, please check neutron logs for more information.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port a12d078b-6529-4a68-89a7-bbe5210045bc, please check neutron logs for more information.
May 06 11:51:48.576298 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-4a84a5d6-9a03-414d-94c8-62c60a926539 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: 6a6115a6-594f-4978-99b7-cde9ca2aa0f4] Setting instance to PAUSED state.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port a12d078b-6529-4a68-89a7-bbe5210045bc, please check neutron logs for more information.
May 06 11:51:50.690078 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:51:50.721008 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:50.721896 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:50.782684 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:50.783426 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:50.784591 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:50.785054 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:50.814110 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Getting quotas for project cedf1edb0c494f7aa22ef62eb82f609d. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:51:50.819148 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Getting quotas for user d9282c2461df4edc8ac633b5d3aba4e1 and project cedf1edb0c494f7aa22ef62eb82f609d. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:51:50.832985 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] [instance: 3a77e720-f8e5-4d4f-8379-619aee2f1253] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:51:50.834344 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:50.834756 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:50.843425 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] [instance: 3a77e720-f8e5-4d4f-8379-619aee2f1253] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:51:50.845054 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:50.845870 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:50.897721 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:50.899382 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-92818def-59b7-4a41-8a01-7ea090929e64 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:53.046361 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:51:53.111485 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:53.112629 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:53.223536 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:53.224428 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:53.226033 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:53.226716 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:53.253017 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Getting quotas for project 541732bc553e4358b233e874e799009e. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:51:53.261589 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Getting quotas for user 2366faac39be42d4b0fd46dcf4f752a0 and project 541732bc553e4358b233e874e799009e. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:51:53.277628 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] [instance: 9c59a5fa-4c36-410b-8676-76c05ff98d1b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:51:53.278377 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:53.278790 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:53.291561 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] [instance: 9c59a5fa-4c36-410b-8676-76c05ff98d1b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:51:53.294577 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:53.295203 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:51:53.345871 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:51:53.346614 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-922703c8-a56a-44f4-976c-c15d4783bdda tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:03.147188 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:52:03.207292 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:03.207731 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:03.325388 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:03.326570 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:03.328200 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:03.329016 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:03.377219 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Getting quotas for project 6670c2e82d334398adfe7ef107be12e9. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:52:03.390044 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Getting quotas for user acc85f3bf784467aad65b1a2484775d6 and project 6670c2e82d334398adfe7ef107be12e9. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:52:03.415597 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] [instance: 4a103d32-29ea-4742-8391-6f7cdb503923] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:52:03.418171 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:03.419183 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:03.449048 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] [instance: 4a103d32-29ea-4742-8391-6f7cdb503923] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:52:03.456925 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:03.460191 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:03.529351 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:03.531395 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6c332a64-e610-446b-8a11-844b029b40f9 tempest-ServersAdminNegativeTestJSON-1645075464 tempest-ServersAdminNegativeTestJSON-1645075464-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:36.558819 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:52:36.677766 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:36.683178 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:36.873272 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:36.873272 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:36.874611 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:36.874611 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:36.908788 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Getting quotas for project a035bdae34fa46b3988e9f69fbbf11a8. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:52:36.915503 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Getting quotas for user 81bc737b925845bdae9c25a864553186 and project a035bdae34fa46b3988e9f69fbbf11a8. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:52:36.936652 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] [instance: d70b94ba-8fda-43c2-8ae1-2480145529c7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:52:36.938198 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:36.938811 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:36.950166 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] [instance: d70b94ba-8fda-43c2-8ae1-2480145529c7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:52:36.952767 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:36.953673 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:37.020620 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:37.021037 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-99eb371a-c84b-49ad-858d-4001b163f634 tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:46.810814 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:52:46.813620 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:46.815407 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:47.651388 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Created allocations for migration 8f09a23c-8b89-4507-9f14-334f083774af on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:52:47.850245 n-d-840842-1 nova-conductor[94343]: DEBUG nova.scheduler.utils [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: 9c59a5fa-4c36-410b-8676-76c05ff98d1b] Instance allocations successfully created on destination node df4c24a4-6db6-4618-b10d-1b3bc259f029: {'allocations': {'df4c24a4-6db6-4618-b10d-1b3bc259f029': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94343) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}}
May 06 11:52:47.850946 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lazy-loading 'resources' on Instance uuid 9c59a5fa-4c36-410b-8676-76c05ff98d1b {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:52:47.864282 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lazy-loading 'pci_requests' on Instance uuid 9c59a5fa-4c36-410b-8676-76c05ff98d1b {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:52:48.270978 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.live_migrate [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: 9c59a5fa-4c36-410b-8676-76c05ff98d1b] Start binding ports on destination host: n-h2-840842-1 {{(pid=94343) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}}
May 06 11:52:49.484349 n-d-840842-1 nova-conductor[94343]: ERROR nova.network.neutron [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: 9c59a5fa-4c36-410b-8676-76c05ff98d1b] Binding failed for port e3eeea0a-b525-42cc-9f36-271232f427fe and host n-h2-840842-1. Error: (500 {"NeutronError": {"type": "PortBindingError", "message": "Binding for port e3eeea0a-b525-42cc-9f36-271232f427fe on host n-h2-840842-1 could not be created or updated.", "detail": ""}})
May 06 11:52:50.061539 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Created allocations for instance 9c59a5fa-4c36-410b-8676-76c05ff98d1b on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}}
May 06 11:52:50.062450 n-d-840842-1 nova-conductor[94343]: WARNING nova.scheduler.utils [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Failed to compute_task_migrate_server: Migration pre-check error: Binding failed for port e3eeea0a-b525-42cc-9f36-271232f427fe, please check neutron logs for more information.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port e3eeea0a-b525-42cc-9f36-271232f427fe, please check neutron logs for more information.
May 06 11:52:50.063374 n-d-840842-1 nova-conductor[94343]: WARNING nova.scheduler.utils [None req-eadd8cbe-39d6-4307-8ef6-3bfa8b1e3f13 tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: 9c59a5fa-4c36-410b-8676-76c05ff98d1b] Setting instance to ACTIVE state.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port e3eeea0a-b525-42cc-9f36-271232f427fe, please check neutron logs for more information.
May 06 11:52:50.218471 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-6868599f-6882-487a-89f1-7e930380fe0c tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:52:50.219039 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6868599f-6882-487a-89f1-7e930380fe0c tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:50.219351 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6868599f-6882-487a-89f1-7e930380fe0c tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:50.255578 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-6868599f-6882-487a-89f1-7e930380fe0c tempest-ServersAdmin275Test-289041747 tempest-ServersAdmin275Test-289041747-project] [instance: d70b94ba-8fda-43c2-8ae1-2480145529c7] No migration record for the rebuild/evacuate request. {{(pid=94344) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 11:52:50.921446 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:52:50.923161 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:52:50.924067 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:52:51.424027 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Created allocations for migration 8875c91d-bad4-4024-95e1-a34a0a4a6d48 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:52:51.639767 n-d-840842-1 nova-conductor[94343]: DEBUG nova.scheduler.utils [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 3a77e720-f8e5-4d4f-8379-619aee2f1253] Instance allocations successfully created on destination node df4c24a4-6db6-4618-b10d-1b3bc259f029: {'allocations': {'df4c24a4-6db6-4618-b10d-1b3bc259f029': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94343) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}}
May 06 11:52:51.640703 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lazy-loading 'resources' on Instance uuid 3a77e720-f8e5-4d4f-8379-619aee2f1253 {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:52:51.646252 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lazy-loading 'pci_requests' on Instance uuid 3a77e720-f8e5-4d4f-8379-619aee2f1253 {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:52:52.061016 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.live_migrate [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 3a77e720-f8e5-4d4f-8379-619aee2f1253] Start binding ports on destination host: n-h2-840842-1 {{(pid=94343) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}}
May 06 11:52:53.370572 n-d-840842-1 nova-conductor[94343]: ERROR nova.network.neutron [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 3a77e720-f8e5-4d4f-8379-619aee2f1253] Binding failed for port 96886a92-5fe8-4584-b827-1e006a52bd39 and host n-h2-840842-1. Error: (500 {"NeutronError": {"type": "PortBindingError", "message": "Binding for port 96886a92-5fe8-4584-b827-1e006a52bd39 on host n-h2-840842-1 could not be created or updated.", "detail": ""}})
May 06 11:52:54.662642 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Created allocations for instance 3a77e720-f8e5-4d4f-8379-619aee2f1253 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}}
May 06 11:52:54.663783 n-d-840842-1 nova-conductor[94343]: WARNING nova.scheduler.utils [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Failed to compute_task_migrate_server: Migration pre-check error: Binding failed for port 96886a92-5fe8-4584-b827-1e006a52bd39, please check neutron logs for more information.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port 96886a92-5fe8-4584-b827-1e006a52bd39, please check neutron logs for more information.
May 06 11:52:54.664090 n-d-840842-1 nova-conductor[94343]: WARNING nova.scheduler.utils [None req-7870b76b-e955-42d1-9692-df1598fa6624 tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: 3a77e720-f8e5-4d4f-8379-619aee2f1253] Setting instance to ACTIVE state.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port 96886a92-5fe8-4584-b827-1e006a52bd39, please check neutron logs for more information.
May 06 11:53:35.340030 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-eb1b2ba5-751b-4a85-b9d8-f3210f80c3c2 tempest-ServersAdmin275Test-488786565 tempest-ServersAdmin275Test-488786565-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:53:35.340885 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eb1b2ba5-751b-4a85-b9d8-f3210f80c3c2 tempest-ServersAdmin275Test-488786565 tempest-ServersAdmin275Test-488786565-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:35.341570 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eb1b2ba5-751b-4a85-b9d8-f3210f80c3c2 tempest-ServersAdmin275Test-488786565 tempest-ServersAdmin275Test-488786565-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:35.439962 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-eb1b2ba5-751b-4a85-b9d8-f3210f80c3c2 tempest-ServersAdmin275Test-488786565 tempest-ServersAdmin275Test-488786565-project-admin] [instance: d70b94ba-8fda-43c2-8ae1-2480145529c7] No migration record for the rebuild/evacuate request. {{(pid=94344) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 11:53:38.606692 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:53:38.752854 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:38.752854 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:38.900377 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:38.900781 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:38.903263 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:38.905587 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:38.945354 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Getting quotas for project 036a8cfd5c7c494c9d5ef13cb6e9dc11. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:53:38.951308 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Getting quotas for user 3432fa2a6dd84ef28b76442b6ba2a982 and project 036a8cfd5c7c494c9d5ef13cb6e9dc11. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:53:38.965691 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] [instance: 11bb99c6-95f9-46ec-8ed2-98a0d395da56] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:53:38.967133 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:38.967737 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:38.979198 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] [instance: 11bb99c6-95f9-46ec-8ed2-98a0d395da56] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=<?>,boot_index=-1,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=1,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:53:38.987535 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:38.990842 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:39.015177 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:39.017893 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:39.100258 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:39.102930 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8aaa97a1-ab42-48e0-bbaa-ea6671e21e95 tempest-ServersWithSpecificFlavorTestJSON-2068020404 tempest-ServersWithSpecificFlavorTestJSON-2068020404-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:43.354808 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:53:43.456068 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:43.456468 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:43.564856 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:43.565350 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:43.566086 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:43.566480 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:43.599465 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Getting quotas for project d04383a39c004447a122869613503452. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:53:43.610505 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Getting quotas for user 79ce0b27ef824255b77b79278d837684 and project d04383a39c004447a122869613503452. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:53:43.635939 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] [instance: 9378a430-319e-4334-8509-ccb6ecb50042] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:53:43.636910 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:43.637348 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:43.655246 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] [instance: 9378a430-319e-4334-8509-ccb6ecb50042] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:53:43.656535 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:43.656940 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:43.745895 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:43.746313 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d90221d9-e0a9-41bc-84f4-513417638194 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:45.534842 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:53:45.656739 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:45.657155 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:45.864110 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:45.864647 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:45.880680 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:45.881084 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:45.957012 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Getting quotas for project 3ce9fa23403f43bb8e9b8d121b06e82c. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:53:45.964176 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Getting quotas for user 70d8eb90e84b4a398b0009dd1b0a95ae and project 3ce9fa23403f43bb8e9b8d121b06e82c. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:53:46.007973 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] [instance: b2a93d85-7326-4e80-9f97-d8cae3c11a63] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:53:46.008898 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:46.009495 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:46.029563 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] [instance: b2a93d85-7326-4e80-9f97-d8cae3c11a63] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:53:46.031720 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:46.032391 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:46.122359 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:46.130775 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-79425308-5a46-4541-a026-bd0a7ec641f6 tempest-ImagesOneServerTestJSON-1992518537 tempest-ImagesOneServerTestJSON-1992518537-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:52.003893 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Took 1.05 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:53:52.152049 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:52.152790 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:52.365240 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:52.370626 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:52.375007 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:52.376805 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:52.465513 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Getting quotas for project d32c64c99a394a7b895c0d9954c9e2b7. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:53:52.479472 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Getting quotas for user 72102bfc70504a0bb42c137e3ba82481 and project d32c64c99a394a7b895c0d9954c9e2b7. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:53:52.518279 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] [instance: b51cc0c0-1ef5-4f8a-b455-cd01dd3e50d8] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:53:52.519892 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:52.520541 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:52.539531 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] [instance: b51cc0c0-1ef5-4f8a-b455-cd01dd3e50d8] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:53:52.541721 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:52.542491 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:52.627898 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:52.629089 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8074a2ad-8674-4692-b77d-80c15ba6bbe5 tempest-ServersTestJSON-585288288 tempest-ServersTestJSON-585288288-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:53.472828 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:53:54.486865 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 59230.
May 06 11:53:56.233732 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:53:56.303003 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:56.304117 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:56.362270 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:56.363554 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:56.365720 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:56.366579 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:56.394378 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Getting quotas for project 541732bc553e4358b233e874e799009e. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:53:56.399239 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Getting quotas for user 2366faac39be42d4b0fd46dcf4f752a0 and project 541732bc553e4358b233e874e799009e. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:53:56.413955 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] [instance: e0d94a42-6cfe-4e21-bcf4-309fef8055ea] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:53:56.415500 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:56.416139 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:56.436159 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] [instance: e0d94a42-6cfe-4e21-bcf4-309fef8055ea] block_device_mapping [BlockDeviceMapping(attachment_id=cafa8ae5-22cb-4446-b5af-cf11bd360544,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='c51947e8-1eab-4df8-97fc-eac8e7ec2931',volume_size=1,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:53:56.437486 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:56.438199 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:56.495968 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:56.496727 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eb2331af-dfd3-4725-b11c-57aabae94aa4 tempest-LiveMigrationTest-861438275 tempest-LiveMigrationTest-861438275-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:56.917259 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:53:56.964822 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:56.965423 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:57.018906 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:57.019379 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:57.020293 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:57.020734 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:57.042749 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Getting quotas for project cedf1edb0c494f7aa22ef62eb82f609d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:53:57.049770 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Getting quotas for user d9282c2461df4edc8ac633b5d3aba4e1 and project cedf1edb0c494f7aa22ef62eb82f609d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:53:57.066773 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] [instance: e9478506-567d-47cd-949f-b0780883562b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:53:57.068330 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:57.069178 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:57.082756 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] [instance: e9478506-567d-47cd-949f-b0780883562b] block_device_mapping [BlockDeviceMapping(attachment_id=7c8dc687-f5eb-46a0-86b9-f0347e502e97,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='c1450b29-f8a2-42f9-8131-6cc379c2f882',volume_size=1,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:53:57.085562 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:57.086591 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:53:57.147594 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:53:57.149002 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-581f6af8-abef-489d-8de6-715389a559b2 tempest-LiveAutoBlockMigrationV225Test-1860098022 tempest-LiveAutoBlockMigrationV225Test-1860098022-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:20.411651 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:54:20.459162 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:20.459822 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:20.518973 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:20.519680 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:20.520424 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:20.520848 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:20.544637 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Getting quotas for project d04383a39c004447a122869613503452. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:54:20.551433 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Getting quotas for user 79ce0b27ef824255b77b79278d837684 and project d04383a39c004447a122869613503452. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:54:20.567488 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] [instance: c2b92fe2-52d5-422c-9140-04e3cf14a8e9] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:54:20.569051 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:20.569860 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:20.580641 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] [instance: c2b92fe2-52d5-422c-9140-04e3cf14a8e9] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:54:20.582719 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:20.583399 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:20.628406 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:20.629044 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-00c0fd48-3e3c-4a21-80a1-5c8a51da10e7 tempest-FloatingIPsAssociationTestJSON-559723962 tempest-FloatingIPsAssociationTestJSON-559723962-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:30.994302 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:54:30.994917 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:30.995206 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:32.165542 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Created allocations for migration 4ef71228-35c3-48ba-a391-05e9c60855ae on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:54:32.493291 n-d-840842-1 nova-conductor[94344]: DEBUG nova.scheduler.utils [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: e9478506-567d-47cd-949f-b0780883562b] Instance allocations successfully created on destination node df4c24a4-6db6-4618-b10d-1b3bc259f029: {'allocations': {'df4c24a4-6db6-4618-b10d-1b3bc259f029': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=94344) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}}
May 06 11:54:32.493778 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lazy-loading 'resources' on Instance uuid e9478506-567d-47cd-949f-b0780883562b {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:54:32.499788 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Lazy-loading 'pci_requests' on Instance uuid e9478506-567d-47cd-949f-b0780883562b {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:54:32.976074 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.live_migrate [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: e9478506-567d-47cd-949f-b0780883562b] Start binding ports on destination host: n-h2-840842-1 {{(pid=94344) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}}
May 06 11:54:34.888031 n-d-840842-1 nova-conductor[94344]: ERROR nova.network.neutron [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: e9478506-567d-47cd-949f-b0780883562b] Binding failed for port c1f72b18-4069-4d91-8117-6265710e7898 and host n-h2-840842-1. Error: (500 {"NeutronError": {"type": "PortBindingError", "message": "Binding for port c1f72b18-4069-4d91-8117-6265710e7898 on host n-h2-840842-1 could not be created or updated.", "detail": ""}})
May 06 11:54:35.599533 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Created allocations for instance e9478506-567d-47cd-949f-b0780883562b on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}}
May 06 11:54:35.601721 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] Failed to compute_task_migrate_server: Migration pre-check error: Binding failed for port c1f72b18-4069-4d91-8117-6265710e7898, please check neutron logs for more information.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port c1f72b18-4069-4d91-8117-6265710e7898, please check neutron logs for more information.
May 06 11:54:35.603322 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-18321053-154c-42bb-b217-debd6293dd6c tempest-LiveAutoBlockMigrationV225Test-352370854 tempest-LiveAutoBlockMigrationV225Test-352370854-project-admin] [instance: e9478506-567d-47cd-949f-b0780883562b] Setting instance to ACTIVE state.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port c1f72b18-4069-4d91-8117-6265710e7898, please check neutron logs for more information.
May 06 11:54:36.207334 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:54:36.209094 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:36.212057 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:36.272180 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:54:36.340975 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:36.348117 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:36.455673 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:36.456947 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:36.468196 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:36.469578 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:36.509747 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Getting quotas for project 74edb08a728a4f16a2e7622599d82407. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:54:36.517292 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Getting quotas for user e1e446cde11c41b9a3ad66e45bbb53dc and project 74edb08a728a4f16a2e7622599d82407. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:54:36.536347 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] [instance: 6e3da571-4e6c-427f-8bf6-fe44c7e5efcc] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:54:36.538052 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:36.539115 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:36.597948 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] [instance: 6e3da571-4e6c-427f-8bf6-fe44c7e5efcc] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:54:36.600536 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:36.600815 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:36.660595 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:36.662273 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc29c445-18d2-4cd7-b873-50dc8271c2da tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:36.774538 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Created allocations for migration 49bed184-2f71-4a08-a16a-1b8f7c89f4f7 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:54:36.952713 n-d-840842-1 nova-conductor[94344]: DEBUG nova.scheduler.utils [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: e0d94a42-6cfe-4e21-bcf4-309fef8055ea] Instance allocations successfully created on destination node df4c24a4-6db6-4618-b10d-1b3bc259f029: {'allocations': {'df4c24a4-6db6-4618-b10d-1b3bc259f029': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=94344) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}}
May 06 11:54:36.953232 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lazy-loading 'resources' on Instance uuid e0d94a42-6cfe-4e21-bcf4-309fef8055ea {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:54:36.961303 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Lazy-loading 'pci_requests' on Instance uuid e0d94a42-6cfe-4e21-bcf4-309fef8055ea {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 11:54:37.383158 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.live_migrate [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: e0d94a42-6cfe-4e21-bcf4-309fef8055ea] Start binding ports on destination host: n-h2-840842-1 {{(pid=94344) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}}
May 06 11:54:38.531550 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Took 1.06 seconds to select destinations for 3 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:54:38.561668 n-d-840842-1 nova-conductor[94344]: ERROR nova.network.neutron [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: e0d94a42-6cfe-4e21-bcf4-309fef8055ea] Binding failed for port e796f32a-40f2-4bbd-97d0-6febd1e5004b and host n-h2-840842-1. Error: (500 {"NeutronError": {"type": "PortBindingError", "message": "Binding for port e796f32a-40f2-4bbd-97d0-6febd1e5004b on host n-h2-840842-1 could not be created or updated.", "detail": ""}})
May 06 11:54:38.627036 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:38.627453 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:38.727762 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:38.728433 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:38.847727 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:38.848698 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:38.949013 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:38.949460 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:38.950247 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:38.950749 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:39.004119 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Getting quotas for project 066ce97d41cd4d9589c32f052d587556. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:54:39.019879 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Getting quotas for user fc35de1509e140008c140e0b549bd8f5 and project 066ce97d41cd4d9589c32f052d587556. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:54:39.055388 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] [instance: 3ff81742-a524-4564-b137-ace01430c43f] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:54:39.057070 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:39.059091 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:39.074930 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] [instance: 3ff81742-a524-4564-b137-ace01430c43f] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:54:39.077473 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:39.078238 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:39.151732 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:39.154028 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:39.179158 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] [instance: 0da1fadb-49b1-4c14-a8d9-a0ea76650da5] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:54:39.183740 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:39.185337 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:39.200610 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] [instance: 0da1fadb-49b1-4c14-a8d9-a0ea76650da5] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:54:39.206428 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:39.206845 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:39.298701 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Created allocations for instance e0d94a42-6cfe-4e21-bcf4-309fef8055ea on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}}
May 06 11:54:39.299739 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] Failed to compute_task_migrate_server: Migration pre-check error: Binding failed for port e796f32a-40f2-4bbd-97d0-6febd1e5004b, please check neutron logs for more information.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port e796f32a-40f2-4bbd-97d0-6febd1e5004b, please check neutron logs for more information.
May 06 11:54:39.300685 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-86ae9d51-8572-4391-8002-9b02ab0eb51f tempest-LiveMigrationTest-1462977141 tempest-LiveMigrationTest-1462977141-project-admin] [instance: e0d94a42-6cfe-4e21-bcf4-309fef8055ea] Setting instance to ACTIVE state.: nova.exception.MigrationPreCheckError: Migration pre-check error: Binding failed for port e796f32a-40f2-4bbd-97d0-6febd1e5004b, please check neutron logs for more information.
May 06 11:54:39.308778 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:39.309277 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:39.335140 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] [instance: abda4015-6794-4296-a40d-6cacb95aac49] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:54:39.337585 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:39.337998 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:39.354751 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] [instance: abda4015-6794-4296-a40d-6cacb95aac49] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:54:39.356147 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:39.356633 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:39.434332 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:39.434822 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee09556d-c43b-4695-8313-ee9dbf366988 tempest-ListServersNegativeTestJSON-713920065 tempest-ListServersNegativeTestJSON-713920065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:40.941017 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Took 1.21 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:54:41.044789 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:41.045971 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:41.245990 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:41.248630 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:41.252420 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:41.254704 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:41.339356 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Getting quotas for project 74edb08a728a4f16a2e7622599d82407. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:54:41.366683 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Getting quotas for user e1e446cde11c41b9a3ad66e45bbb53dc and project 74edb08a728a4f16a2e7622599d82407. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:54:41.424564 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] [instance: 50452bcc-0ebe-4646-a81c-9a9d0a3da772] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:54:41.426716 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:41.430955 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:41.450088 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] [instance: 50452bcc-0ebe-4646-a81c-9a9d0a3da772] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:54:41.457729 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:41.459221 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:54:41.559699 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:54:41.562510 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5eba4919-3dc2-4d97-a7e2-b58a84210d6d tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:22.851036 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:55:22.876709 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:22.877234 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:22.947079 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:22.948168 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:22.950028 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:22.950977 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:22.979968 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Getting quotas for project 74edb08a728a4f16a2e7622599d82407. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:55:22.988488 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Getting quotas for user e1e446cde11c41b9a3ad66e45bbb53dc and project 74edb08a728a4f16a2e7622599d82407. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:55:23.006659 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] [instance: b3e7d75f-7b17-41e6-b119-c5742f80dca8] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:55:23.008373 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:23.009071 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:23.035822 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] [instance: b3e7d75f-7b17-41e6-b119-c5742f80dca8] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:55:23.039198 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:23.039927 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:23.099845 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:23.101313 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c127b8bc-3ff5-4fcc-911a-a6c3456e6f19 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:41.868653 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:55:42.881353 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 60998.
May 06 11:55:51.801254 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:55:51.848287 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:51.849258 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:51.941302 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:51.942174 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:51.943192 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:51.943829 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:51.964575 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Getting quotas for project 9a68eecb286349cd9fe84431969f1f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:55:51.970396 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Getting quotas for user 5aec44a7d7234b9d974d3f9b1a7c3f0a and project 9a68eecb286349cd9fe84431969f1f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:55:51.985026 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: 5b1daebf-c8ee-4eaf-b17f-fec83d682a32] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:55:51.986873 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:51.987540 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:51.998320 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: 5b1daebf-c8ee-4eaf-b17f-fec83d682a32] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:55:52.001891 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:52.003391 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:52.062256 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:52.063211 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f3b80d73-896a-4b3f-8e7c-801bbc14adfb tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:53.550385 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:55:53.578060 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:53.578726 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:53.686329 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:53.686618 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:53.687633 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:53.688175 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:53.708655 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Getting quotas for project 4fdfc77644024264ab9cc67cb50478bf. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:55:53.713916 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Getting quotas for user e3e0621a1f8440369259c644d9f0177d and project 4fdfc77644024264ab9cc67cb50478bf. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:55:53.727668 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] [instance: 8b3be62f-5bdd-4623-847e-016dc9c588ae] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:55:53.728332 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:53.728732 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:53.737071 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] [instance: 8b3be62f-5bdd-4623-847e-016dc9c588ae] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:55:53.738439 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:53.738885 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:55:53.790197 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:55:53.791193 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5ee8a0a0-1cbd-42c4-955c-1abb975f20c4 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:10.746382 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-02b2a5f9-7448-4043-ad3e-541dca0907bc tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:56:10.754862 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-02b2a5f9-7448-4043-ad3e-541dca0907bc tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:10.755954 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-02b2a5f9-7448-4043-ad3e-541dca0907bc tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:10.816001 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-02b2a5f9-7448-4043-ad3e-541dca0907bc tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] [instance: 6e3da571-4e6c-427f-8bf6-fe44c7e5efcc] No migration record for the rebuild/evacuate request. {{(pid=94344) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 11:56:17.626279 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:56:17.666703 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:17.667192 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:17.733356 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:17.733769 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:17.734566 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:17.734965 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:17.755930 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Getting quotas for project 5fae6826eacf4efab56693e0cf48edba. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:56:17.761386 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Getting quotas for user 4ea13f8ac8fe4297834a3a59c48d328b and project 5fae6826eacf4efab56693e0cf48edba. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:56:17.775054 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] [instance: 4a3f3608-2a6f-40df-aee9-97b375ff9483] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:56:17.776439 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:17.777058 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:17.786855 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] [instance: 4a3f3608-2a6f-40df-aee9-97b375ff9483] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:56:17.789240 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:17.789988 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:17.845590 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:17.846726 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-314cf2dc-ed9f-4796-a324-f6f9fe2e006d tempest-ServerAddressesNegativeTestJSON-1762032340 tempest-ServerAddressesNegativeTestJSON-1762032340-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:32.361422 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-72b6dc25-bcd9-4b30-8ab7-fb9a7ad33de9 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:56:32.362300 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-72b6dc25-bcd9-4b30-8ab7-fb9a7ad33de9 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:32.377615 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-72b6dc25-bcd9-4b30-8ab7-fb9a7ad33de9 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:33.218584 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-72b6dc25-bcd9-4b30-8ab7-fb9a7ad33de9 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] [instance: 5b1daebf-c8ee-4eaf-b17f-fec83d682a32] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94344) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 11:56:33.929525 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-72b6dc25-bcd9-4b30-8ab7-fb9a7ad33de9 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] Created allocations for migration 7b915017-5478-4944-ba21-54aba98101bb on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:56:34.659503 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-72b6dc25-bcd9-4b30-8ab7-fb9a7ad33de9 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] [instance: 5b1daebf-c8ee-4eaf-b17f-fec83d682a32] Calling prep_resize with selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94344) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 11:56:38.398940 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:56:38.545599 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:38.546006 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:38.638306 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:38.638715 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:38.639441 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:38.639834 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:38.675426 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Getting quotas for project 4fdfc77644024264ab9cc67cb50478bf. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:56:38.681328 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Getting quotas for user e3e0621a1f8440369259c644d9f0177d and project 4fdfc77644024264ab9cc67cb50478bf. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:56:38.702745 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] [instance: bd9ed9b2-c281-4a54-bda5-724ffe5d859a] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:56:38.703719 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:38.704115 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:38.714882 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] [instance: bd9ed9b2-c281-4a54-bda5-724ffe5d859a] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:56:38.716307 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:38.716704 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:38.776679 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:38.777497 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1a0b947b-a51d-4744-a81e-8612bfd81ce5 tempest-LiveMigrationNegativeTest-31159814 tempest-LiveMigrationNegativeTest-31159814-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:41.132315 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:56:41.165102 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:41.166379 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:41.316566 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:41.318721 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:41.320856 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:41.321579 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:41.409652 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Getting quotas for project a3d9231f16804fc59b992998e1fc43a2. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:56:41.440593 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Getting quotas for user bd29681fea9244a6a0baf0caaef16ec0 and project a3d9231f16804fc59b992998e1fc43a2. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:56:41.491935 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] [instance: a703ffcf-a94b-4919-8e76-62b135300876] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:56:41.493499 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:41.494082 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:41.513698 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] [instance: a703ffcf-a94b-4919-8e76-62b135300876] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:56:41.518782 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:41.522192 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:41.620151 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:41.623009 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-df1f0b92-bac5-432a-828f-6696a8cebff2 tempest-FloatingIPsAssociationNegativeTestJSON-488392136 tempest-FloatingIPsAssociationNegativeTestJSON-488392136-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:53.484791 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f81bb9d0-3533-4f53-a7b7-d600a31a9975 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:56:53.488090 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f81bb9d0-3533-4f53-a7b7-d600a31a9975 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:56:53.488755 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f81bb9d0-3533-4f53-a7b7-d600a31a9975 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:56:53.563861 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f81bb9d0-3533-4f53-a7b7-d600a31a9975 tempest-ServersAdminTestJSON-40581665 tempest-ServersAdminTestJSON-40581665-project] [instance: 6e3da571-4e6c-427f-8bf6-fe44c7e5efcc] No migration record for the rebuild/evacuate request. {{(pid=94343) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 11:56:54.485197 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:56:55.495836 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 33940.
May 06 11:57:26.469159 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:57:26.563446 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:26.569649 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:26.711397 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:26.712028 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:26.712927 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:26.713387 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:26.773241 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Getting quotas for project 9a68eecb286349cd9fe84431969f1f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:57:26.785962 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Getting quotas for user 5aec44a7d7234b9d974d3f9b1a7c3f0a and project 9a68eecb286349cd9fe84431969f1f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:57:26.819942 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: 6e235c7d-c209-4a61-b57b-b892760ccc99] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:57:26.822242 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:26.824357 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:26.839304 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: 6e235c7d-c209-4a61-b57b-b892760ccc99] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:57:26.842754 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:26.844581 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:26.909646 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:26.910762 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-87378d4c-84f8-4291-8526-b45220a24461 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:33.838933 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:57:33.901327 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:33.901749 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:34.015151 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:34.015563 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:34.016382 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:34.016688 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:34.076424 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Getting quotas for project dbccc671564a49cb85c9f92b38308798. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:57:34.084923 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Getting quotas for user 322ace515fb94eca923cbda11b3a0e2d and project dbccc671564a49cb85c9f92b38308798. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:57:34.111085 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] [instance: b6432353-fa1f-4605-863e-54bd82e8cfd5] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:57:34.114884 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:34.115798 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:34.132813 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] [instance: b6432353-fa1f-4605-863e-54bd82e8cfd5] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:57:34.137062 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:34.140164 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:34.258281 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:34.258921 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6f928da7-6133-4f4d-904f-237244322013 tempest-ServerMetadataNegativeTestJSON-704823986 tempest-ServerMetadataNegativeTestJSON-704823986-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:52.370642 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:57:52.460093 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:52.463654 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:52.614277 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:52.614883 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:52.617593 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:52.618901 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:52.652710 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Getting quotas for project e945f034ad3344318f855faf41e3aa86. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:57:52.660909 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Getting quotas for user 97976818b27840ea98b64637118be5fe and project e945f034ad3344318f855faf41e3aa86. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:57:52.690298 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] [instance: 339b9efe-7613-4639-8a81-050b5feca53b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:57:52.692452 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:52.693660 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:52.711013 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] [instance: 339b9efe-7613-4639-8a81-050b5feca53b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:57:52.715970 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:52.717024 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:57:52.797177 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:57:52.797356 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e66ebb2f-a535-411c-9db1-9360c62c7a3a tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:10.820501 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-0fb92734-6337-41b1-a9a4-a85d735d6e8c tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:58:10.824209 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0fb92734-6337-41b1-a9a4-a85d735d6e8c tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:10.824937 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0fb92734-6337-41b1-a9a4-a85d735d6e8c tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:11.408134 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-0fb92734-6337-41b1-a9a4-a85d735d6e8c tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: 6e235c7d-c209-4a61-b57b-b892760ccc99] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94343) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 11:58:12.141546 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-0fb92734-6337-41b1-a9a4-a85d735d6e8c tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Created allocations for migration 6274aeef-b404-4777-b383-7eb5a1679bec on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:58:12.679370 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-0fb92734-6337-41b1-a9a4-a85d735d6e8c tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: 6e235c7d-c209-4a61-b57b-b892760ccc99] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94343) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 11:58:12.964479 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:58:13.050249 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:13.051267 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:13.156621 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:13.157651 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:13.160045 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:13.160936 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:13.193691 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Getting quotas for project c6aac4bed5624241a73fa2452d824a65. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:58:13.202938 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Getting quotas for user bfdd532637d84f039212c4f79866cc36 and project c6aac4bed5624241a73fa2452d824a65. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:58:13.248642 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] [instance: 1bfa2036-dd91-4a06-a2cc-1bde8d07a5a2] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:58:13.258293 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:13.259061 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:13.271125 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] [instance: 1bfa2036-dd91-4a06-a2cc-1bde8d07a5a2] block_device_mapping [BlockDeviceMapping(attachment_id=3e123cbd-06a8-4d4f-b3d3-19597ecd1d02,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=<?>,uuid=<?>,volume_id='23a66139-89dd-4d9c-a3bc-dddada40ec2d',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=cdb593f0-981c-4edc-a7ec-f36e387537ed,boot_index=1,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=<?>,uuid=<?>,volume_id='383cefbe-6a4c-47c7-96be-d34dcafe7e35',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=30014c71-b4ae-4444-8e30-8858fac070e0,boot_index=2,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='d941f030-ed20-4bde-87cc-18c21ed89541',volume_size=1,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:58:13.275419 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:13.276549 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:13.296039 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:13.297320 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:13.314052 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:13.316618 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:13.395506 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:13.396037 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-8ac98900-6feb-4a49-ae65-5294410e121d tempest-TaggedBootDevicesTest-1941631488 tempest-TaggedBootDevicesTest-1941631488-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:30.687317 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:58:30.735412 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:30.736587 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:30.839998 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:30.841416 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:30.842404 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:30.842794 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:30.868456 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Getting quotas for project 35973ff2d9bf4eb098bb765aa66111c3. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:58:30.882459 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Getting quotas for user fdde62cc9dd14e54aae0280538f40cfc and project 35973ff2d9bf4eb098bb765aa66111c3. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:58:30.901706 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] [instance: 00280b01-8bf3-45c2-87e1-187fc0637263] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:58:30.902985 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:30.903716 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:30.921990 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] [instance: 00280b01-8bf3-45c2-87e1-187fc0637263] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:58:30.924056 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:30.924801 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:30.964943 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:30.965532 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-01649a83-34ab-4164-b3ac-915e497cafea tempest-TenantUsagesTestJSON-131684546 tempest-TenantUsagesTestJSON-131684546-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:42.880074 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:58:43.889988 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 35308.
May 06 11:58:50.794694 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:58:50.842130 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:50.842849 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:50.998084 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:50.999481 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:51.001286 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:51.002577 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:51.030072 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:58:51.037758 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for user 49c88784ad5044568c7e35312526a1bb and project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:58:51.065554 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: fa9fa7f4-c29c-4b24-8842-7401a7a73400] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:58:51.067226 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:51.067996 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:51.087349 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: fa9fa7f4-c29c-4b24-8842-7401a7a73400] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:58:51.089824 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:51.090841 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:58:51.162510 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:58:51.163409 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5c80e034-0ffc-4ebd-87ac-beec3cf526e5 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:04.894696 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:59:04.939723 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:04.940414 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:05.047042 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:05.048891 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:05.050052 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:05.050940 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:05.083275 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Getting quotas for project e3070f4357554dafb080efe7ef8f4254. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:59:05.106349 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Getting quotas for user a41bed17f06247c4b162f4ea12290c04 and project e3070f4357554dafb080efe7ef8f4254. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:59:05.136569 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] [instance: 0f87eb08-b94b-4c4c-a790-7e0303abcc16] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:59:05.137579 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:05.140239 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:05.159298 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] [instance: 0f87eb08-b94b-4c4c-a790-7e0303abcc16] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:59:05.160674 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:05.161068 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:05.217789 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:05.218237 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a82cdbc5-41ca-4592-82f1-c0d649bbbf37 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:07.161449 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:59:07.206743 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:07.207518 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:07.289374 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:07.290104 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:07.291074 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:07.291661 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:07.333931 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Getting quotas for project 9a68eecb286349cd9fe84431969f1f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:59:07.350852 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Getting quotas for user 5aec44a7d7234b9d974d3f9b1a7c3f0a and project 9a68eecb286349cd9fe84431969f1f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:59:07.424609 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: f24f53bd-d7f2-42fc-80fe-1de2e7429c0b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:59:07.429198 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:07.438135 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:07.458510 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: f24f53bd-d7f2-42fc-80fe-1de2e7429c0b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:59:07.463490 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:07.471505 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:07.567070 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:07.568182 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-42e42264-0875-4598-9075-1b983db5bcde tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:18.951589 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 11:59:36.620342 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:36.621512 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:37.536422 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Took 0.84 seconds to select destinations for 2 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:59:37.574952 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:37.575904 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:37.664200 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:37.665589 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:37.792022 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:37.792424 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:37.793187 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:37.794312 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:37.836056 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:59:37.846996 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for user 49c88784ad5044568c7e35312526a1bb and project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:59:37.873028 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: d046a925-7ac4-41b2-87c9-be0efc02d698] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:59:37.874438 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:37.876041 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:37.889917 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: d046a925-7ac4-41b2-87c9-be0efc02d698] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:59:37.892845 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:37.893674 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:37.956924 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:37.957441 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:37.975986 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: fbc044d6-4bb0-42ee-8986-ca07e02420ae] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:59:37.977074 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance_group [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lazy-loading 'hosts' on InstanceGroup uuid d8cdef91-14bf-42a8-968f-965dcff7f6cc {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}}
May 06 11:59:38.005313 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:38.006765 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:38.019255 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: fbc044d6-4bb0-42ee-8986-ca07e02420ae] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:59:38.020631 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:38.021330 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:38.071692 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:38.072504 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-dc6dc197-a1d4-4e39-8729-7ba65e9c74db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:39.451608 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 11:59:39.543159 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:39.543824 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:39.702404 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:39.703116 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:39.704355 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:39.705419 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:39.755314 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Getting quotas for project e945f034ad3344318f855faf41e3aa86. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 11:59:39.765668 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Getting quotas for user 97976818b27840ea98b64637118be5fe and project e945f034ad3344318f855faf41e3aa86. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 11:59:39.804819 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] [instance: 15ce14c0-0604-4a4c-bcbf-da9c792e05a7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 11:59:39.809705 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:39.811792 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:39.831859 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] [instance: 15ce14c0-0604-4a4c-bcbf-da9c792e05a7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 11:59:39.833579 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:39.834726 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:39.892693 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:39.893177 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3e2a2849-3b78-4cc1-b708-bbcbedcf41e0 tempest-ServersTestMultiNic-708193715 tempest-ServersTestMultiNic-708193715-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:43.025661 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-bac815ac-f741-4fea-bdfd-3628a5824768 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 11:59:43.034170 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bac815ac-f741-4fea-bdfd-3628a5824768 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 11:59:43.034939 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bac815ac-f741-4fea-bdfd-3628a5824768 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 11:59:43.422195 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-bac815ac-f741-4fea-bdfd-3628a5824768 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: f24f53bd-d7f2-42fc-80fe-1de2e7429c0b] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94343) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 11:59:44.034306 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-bac815ac-f741-4fea-bdfd-3628a5824768 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Created allocations for migration 6462d25f-abe9-4de1-a58f-896ed67ee8ae on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 11:59:44.298316 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-bac815ac-f741-4fea-bdfd-3628a5824768 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: f24f53bd-d7f2-42fc-80fe-1de2e7429c0b] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94343) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 11:59:55.498891 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 11:59:56.515660 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 35992.
May 06 12:00:05.099008 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:00:28.781882 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:00:28.837419 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:28.839874 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:28.930347 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:28.930891 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:28.931629 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:28.932326 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:28.975702 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Getting quotas for project e3070f4357554dafb080efe7ef8f4254. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:00:28.998198 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Getting quotas for user a41bed17f06247c4b162f4ea12290c04 and project e3070f4357554dafb080efe7ef8f4254. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:00:29.012733 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] [instance: 71eaa1bc-c83f-4fc0-a2b0-0296614bf866] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:00:29.013635 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:29.014317 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:29.024240 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] [instance: 71eaa1bc-c83f-4fc0-a2b0-0296614bf866] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:00:29.026510 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:29.027308 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:29.069650 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:29.070456 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-936c58d6-3b8e-4a17-a59e-0a49c6bb5260 tempest-ServerRescueTestJSON-443748086 tempest-ServerRescueTestJSON-443748086-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:40.163945 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:40.164582 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:40.944629 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Took 0.72 seconds to select destinations for 2 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:00:41.006728 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.007356 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:41.149088 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.149799 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:41.225009 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.226441 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:41.227604 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.228003 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:41.247634 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:00:41.254251 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for user 49c88784ad5044568c7e35312526a1bb and project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:00:41.267313 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 1fd6ed2c-4a91-406f-afe6-90a0a15990f6] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:00:41.269193 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.269768 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:41.292683 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 1fd6ed2c-4a91-406f-afe6-90a0a15990f6] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:00:41.298311 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.299250 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:41.386234 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.387209 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:41.429359 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 7b7e10b7-5727-4b38-b49a-2097886acd84] Selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:00:41.430516 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance_group [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lazy-loading 'hosts' on InstanceGroup uuid 15c52040-31dd-4431-81dc-dcf8c1f71466 {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}}
May 06 12:00:41.483432 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.484274 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:41.504232 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 7b7e10b7-5727-4b38-b49a-2097886acd84] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:00:41.507181 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.508652 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:00:41.612808 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:00:41.614334 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8bf5ff57-a24b-48a2-98a8-421f5f61f3f1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:05.492723 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:01:05.596524 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:05.596524 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:05.732399 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:05.733964 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:05.735674 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:05.736642 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:05.771045 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Getting quotas for project 9a68eecb286349cd9fe84431969f1f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:01:05.780417 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Getting quotas for user 5aec44a7d7234b9d974d3f9b1a7c3f0a and project 9a68eecb286349cd9fe84431969f1f4d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:01:05.810264 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: 4d837f1e-5599-4315-a440-baa01c6f4487] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:01:05.813709 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:05.815006 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:05.829736 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] [instance: 4d837f1e-5599-4315-a440-baa01c6f4487] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:01:05.835715 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:05.836937 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:05.929755 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:05.939709 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c74cf5a0-f874-4e7b-8198-eab1a886ce66 tempest-MigrationsAdminTest-1672013441 tempest-MigrationsAdminTest-1672013441-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:09.071865 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Took 1.20 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:01:09.123166 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:09.124347 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:09.299489 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:09.299489 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:09.304233 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:09.304233 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:09.367115 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Getting quotas for project 2fecdbb4c3c44498904a8c44171913e4. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:01:09.367115 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Getting quotas for user 6266b87918b44c72b04e21b8ef0d9bf1 and project 2fecdbb4c3c44498904a8c44171913e4. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:01:09.399916 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] [instance: d90beed2-f29a-414f-a506-2418a6b9bf72] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:01:09.399916 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:09.399916 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:09.416491 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] [instance: d90beed2-f29a-414f-a506-2418a6b9bf72] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:01:09.427144 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:09.427865 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:09.513459 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:09.513459 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ce9117a4-e78a-45c3-a779-807e932266c3 tempest-ImagesNegativeTestJSON-1201321210 tempest-ImagesNegativeTestJSON-1201321210-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:42.232748 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:01:42.331562 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:42.334271 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:42.477149 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:42.477743 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:42.479317 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:42.480206 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:42.524625 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:01:42.534971 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for user 49c88784ad5044568c7e35312526a1bb and project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:01:42.570395 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 7790e571-f521-481a-8855-117d9ae01430] Selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:01:42.572086 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:42.572726 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:42.593216 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 7790e571-f521-481a-8855-117d9ae01430] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:01:42.595286 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:42.595909 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:42.701574 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:42.702591 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-14b6d4be-92ac-4642-90fa-b08d1a1650db tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:43.890962 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:01:44.900452 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 36898.
May 06 12:01:47.561171 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:01:47.636049 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:47.648155 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:47.790782 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:47.797226 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:47.800172 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:47.802366 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:47.866914 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:01:47.883168 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for user d64804a5216f4c41a3b6473ada11fdca and project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:01:47.913762 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: bc12c4fa-a638-412a-8020-ecc14337c246] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:01:47.916169 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:47.919053 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:47.936259 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: bc12c4fa-a638-412a-8020-ecc14337c246] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:01:47.941467 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:47.942494 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:48.030979 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:48.032247 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f6ed6cec-8d74-4bc0-a6d5-09c3a4a53633 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:55.784902 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:01:55.841511 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:55.843881 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:55.942339 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:55.942765 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:55.944860 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:55.945520 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:55.996922 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Getting quotas for project 05bb3267cfd24d71affa69412da56037. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:01:56.004909 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Getting quotas for user 5ff14b20015d450ea3d3c5317f34696f and project 05bb3267cfd24d71affa69412da56037. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:01:56.021969 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] [instance: b7ff5452-bb4a-4ae0-9f86-c6e81503415a] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:01:56.024033 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:56.024757 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:56.046034 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] [instance: b7ff5452-bb4a-4ae0-9f86-c6e81503415a] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:01:56.048275 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:56.048787 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:56.100064 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:56.101217 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4fe48e40-e848-4519-9686-f30b835e9acf tempest-InstanceActionsTestJSON-1271854985 tempest-InstanceActionsTestJSON-1271854985-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:58.333335 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-536e0499-0d81-49c7-ba52-ffdb1dd7ff06 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:01:58.337496 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-536e0499-0d81-49c7-ba52-ffdb1dd7ff06 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:01:58.338552 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-536e0499-0d81-49c7-ba52-ffdb1dd7ff06 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:01:58.567452 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-536e0499-0d81-49c7-ba52-ffdb1dd7ff06 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] [instance: 4d837f1e-5599-4315-a440-baa01c6f4487] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94343) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 12:01:59.022250 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-536e0499-0d81-49c7-ba52-ffdb1dd7ff06 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] Created allocations for migration a0d5001f-8306-46ef-8e8e-e3ac3bb0fb24 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 12:01:59.388414 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-536e0499-0d81-49c7-ba52-ffdb1dd7ff06 tempest-MigrationsAdminTest-115664187 tempest-MigrationsAdminTest-115664187-project-admin] [instance: 4d837f1e-5599-4315-a440-baa01c6f4487] Calling prep_resize with selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94343) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 12:02:00.292612 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:02:00.353638 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:00.354819 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:00.450038 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:00.451052 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:00.452669 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:00.453524 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:00.491556 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:02:00.504877 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for user f1c6cf8cf1ee4ce6acb1f3c3b196af39 and project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:02:00.521547 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: b7c12bca-6f90-49c6-96d7-e84a66ef32ac] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:02:00.523219 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:00.523525 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:00.534751 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: b7c12bca-6f90-49c6-96d7-e84a66ef32ac] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:02:00.537833 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:00.539284 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:00.625143 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:00.652682 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a49f993d-d034-4972-8de5-aa360ceee5b2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:11.208928 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:02:11.234326 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:11.234728 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:11.285937 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:11.286553 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:11.287784 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:11.288185 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:11.313902 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:02:11.319062 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for user 49c88784ad5044568c7e35312526a1bb and project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:02:11.330954 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 16588c1a-9b62-4895-9bdf-6d3b65dcd1c5] Selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:02:11.332444 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:11.333011 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:11.345183 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 16588c1a-9b62-4895-9bdf-6d3b65dcd1c5] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:02:11.347118 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:11.347845 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:11.403241 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:11.403241 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-8d8ca991-6503-4edb-b001-f0a22b5b3cfc tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:34.365925 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:02:34.426079 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:34.426540 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:34.514038 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:34.514440 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:34.517856 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:34.518521 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:34.559516 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:02:34.575094 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Getting quotas for user 49c88784ad5044568c7e35312526a1bb and project 3b9bc3ea26cd475494c510caf3d57936. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:02:34.605476 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 25d5992c-c3ff-4bd4-9792-dc57fe6baeaf] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:02:34.606594 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:34.607017 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:34.623525 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] [instance: 25d5992c-c3ff-4bd4-9792-dc57fe6baeaf] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:02:34.625336 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:34.625756 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:34.679060 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:34.679606 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a1461dd4-e3d5-46b7-ba7a-abe62cd718d1 tempest-ServersOnMultiNodesTest-1625839504 tempest-ServersOnMultiNodesTest-1625839504-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:38.978784 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:02:42.644222 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:02:42.676098 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:42.676513 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:42.781540 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:42.783838 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:42.786356 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:42.788577 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:42.839511 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:02:42.857587 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for user f1c6cf8cf1ee4ce6acb1f3c3b196af39 and project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:02:42.916297 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: 3b3e31a1-f641-4606-954c-b08b990df41c] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:02:42.923822 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:42.923822 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:42.958567 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: 3b3e31a1-f641-4606-954c-b08b990df41c] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:02:42.967278 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:42.967278 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:43.057795 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:02:43.057795 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7715cdb7-2896-4d52-a09e-d4b285b51cee tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:02:56.514437 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:02:57.524509 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38004.
May 06 12:03:06.460456 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:03:06.532864 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:06.533956 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:06.652088 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:06.652826 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:06.656210 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:06.656965 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:06.749991 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Getting quotas for project 9f9eb23b11c2423d8010ebcf57c4a6ca. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:03:06.790726 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Getting quotas for user 4d7c5e5403c24759b7937a6aa167419e and project 9f9eb23b11c2423d8010ebcf57c4a6ca. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:03:06.862389 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] [instance: 04444b3f-bf64-4b54-a067-298e347f0e8e] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:03:06.867992 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:06.873791 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:06.897096 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] [instance: 04444b3f-bf64-4b54-a067-298e347f0e8e] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:03:06.903364 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:06.914085 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:06.994919 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:06.996710 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5aabf55f-fc7c-414d-b737-fd7d10335e03 tempest-ServerRescueTestJSONUnderV235-227079042 tempest-ServerRescueTestJSONUnderV235-227079042-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:25.114315 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:03:28.121434 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Took 0.72 seconds to select destinations for 2 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:03:28.175837 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.176521 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:28.389844 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.390530 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:28.506203 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.508105 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:28.511215 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.512194 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:28.559462 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Getting quotas for project 22bbf64cd16d4f03ba0b15f66cabe595. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:03:28.572368 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Getting quotas for user ab32679fead7491e896f9cc362b676dc and project 22bbf64cd16d4f03ba0b15f66cabe595. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:03:28.607275 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] [instance: bc235b8f-728d-411c-b257-6a370d056355] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:03:28.611062 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.612774 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:28.628735 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] [instance: bc235b8f-728d-411c-b257-6a370d056355] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:03:28.636285 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.637447 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:28.710458 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.711923 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:28.742842 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] [instance: 7ab0f7e9-af6a-4df8-9230-2b3601df92e2] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:03:28.748565 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.749418 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:28.758803 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] [instance: 7ab0f7e9-af6a-4df8-9230-2b3601df92e2] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:03:28.761601 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.762182 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:28.864858 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:28.866442 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b45a168d-2bd3-42e5-a3d5-6b7f99c59a19 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:51.471960 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:03:51.513931 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:51.514859 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:51.595672 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:51.596512 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:51.597741 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:51.609573 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:51.634855 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Getting quotas for project ffacc0a8abb14d15910dca33cfaffe89. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:03:51.643142 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Getting quotas for user eed6affbe42e4a22b38781c6b89659df and project ffacc0a8abb14d15910dca33cfaffe89. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:03:51.659443 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] [instance: 31089a08-a436-436b-8e3f-0b704ae7143f] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:03:51.661214 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:51.661849 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:51.687040 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] [instance: 31089a08-a436-436b-8e3f-0b704ae7143f] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:03:51.691129 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:51.695236 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:51.772207 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:51.773198 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0d3fb077-e4b9-4d70-81f4-4a735006236b tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:55.265576 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:03:55.320473 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:55.320883 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:55.454811 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:55.457923 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:55.459154 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:55.460706 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:55.496400 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:03:55.503176 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for user f1c6cf8cf1ee4ce6acb1f3c3b196af39 and project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:03:55.518195 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: d64bf3d9-7729-47ee-a97f-379d5bee51f6] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:03:55.519516 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:55.520096 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:55.532747 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: d64bf3d9-7729-47ee-a97f-379d5bee51f6] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:03:55.537163 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:55.537393 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:03:55.582880 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:03:55.586108 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663db15-80a0-4a5b-baca-248cadef7edd tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:11.330009 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Took 0.60 seconds to select destinations for 2 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:04:11.435677 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:11.443009 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:11.647657 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:11.648329 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:11.740176 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:11.741372 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:11.742934 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:11.743847 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:11.833083 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Getting quotas for project 22bbf64cd16d4f03ba0b15f66cabe595. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:04:11.847236 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Getting quotas for user ab32679fead7491e896f9cc362b676dc and project 22bbf64cd16d4f03ba0b15f66cabe595. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:04:11.875243 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] [instance: 04110c01-a21e-46fc-9025-5331df58890a] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:04:11.878000 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:11.879047 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:11.914539 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] [instance: 04110c01-a21e-46fc-9025-5331df58890a] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:04:11.916292 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:11.917321 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:11.980972 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:11.981402 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:12.003006 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] [instance: 023aec95-1a5b-4c0c-9c5a-e802e3ad83c7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:04:12.003978 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:12.004381 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:12.021357 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] [instance: 023aec95-1a5b-4c0c-9c5a-e802e3ad83c7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:04:12.023560 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:12.024777 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:12.108678 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:12.109626 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-98132b0f-d4a3-48bf-be77-5bd7f6174757 tempest-MultipleCreateTestJSON-1578782990 tempest-MultipleCreateTestJSON-1578782990-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:30.534943 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:04:30.597064 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:30.603526 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:30.759886 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:30.760450 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:30.761767 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:30.762275 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:30.804704 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:04:30.820501 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for user f1c6cf8cf1ee4ce6acb1f3c3b196af39 and project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:04:30.871379 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: 111ea5fb-43e5-4e32-a0de-a0f68afdd091] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:04:30.876133 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:30.885096 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:30.906593 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: 111ea5fb-43e5-4e32-a0de-a0f68afdd091] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:04:30.909708 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:30.911781 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:30.980076 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:30.980804 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a565bba1-7a2d-46fa-839b-cffed404cab2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:44.907568 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:04:45.922329 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 39456.
May 06 12:04:46.205805 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:04:46.257863 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:46.265693 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:46.369876 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:46.371507 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:46.373006 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:46.391536 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:46.410454 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Getting quotas for project 6ebd85b870c24c15b04baab796ca97b8. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:04:46.416642 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Getting quotas for user 3619189c0e3e482bac5f752575120132 and project 6ebd85b870c24c15b04baab796ca97b8. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:04:46.430565 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] [instance: a003baa5-b60d-4a1f-a314-fc45a06a013b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:04:46.432475 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:46.433082 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:46.443807 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] [instance: a003baa5-b60d-4a1f-a314-fc45a06a013b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:04:46.446011 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:46.446873 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:04:46.487709 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:04:46.488912 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bda238cf-9af8-4e04-bdd2-4bf221634907 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:29.298698 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:05:29.358396 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:29.359516 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:29.503756 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:29.508226 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:29.509456 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:29.510077 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:29.551828 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:05:29.566782 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for user d64804a5216f4c41a3b6473ada11fdca and project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:05:29.594493 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: d0c30e8a-e6d0-470c-be46-16963586d67d] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:05:29.614105 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:29.616106 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:29.637689 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: d0c30e8a-e6d0-470c-be46-16963586d67d] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:05:29.643189 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:29.644991 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:29.736224 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:29.736932 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3d8ae38-ece5-4c2b-95de-9d47b571e19b tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:34.967530 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:05:34.999118 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:35.000482 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:35.091780 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:35.093416 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:35.097395 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:35.098673 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:35.169800 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:05:35.224667 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for user f1c6cf8cf1ee4ce6acb1f3c3b196af39 and project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:05:35.267749 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: a57c4c79-6c62-48d6-b17f-c2e1dfe36195] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:05:35.273477 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:35.274327 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:35.296653 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: a57c4c79-6c62-48d6-b17f-c2e1dfe36195] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:05:35.298884 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:35.299504 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:35.400415 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:35.403725 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-96b0131d-87b0-48b0-b7ae-c98a9ac20817 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:52.651247 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:05:52.725894 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:52.728315 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:52.838752 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:52.839772 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:52.842740 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:52.843697 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:52.884524 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Getting quotas for project 512fb78e722d408594f3c77de79e06dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:05:52.897552 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Getting quotas for user 19fe9468e0db4a04815e485dc0ce7987 and project 512fb78e722d408594f3c77de79e06dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:05:52.925024 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] [instance: c2f5ee0e-7690-4f4a-af46-0af05a410446] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:05:52.926274 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:52.927419 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:52.941763 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] [instance: c2f5ee0e-7690-4f4a-af46-0af05a410446] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:05:52.943576 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:52.944151 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:53.007870 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:53.008427 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ac5f29be-998c-4f1c-8e0d-7df1c5d11a96 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:57.528157 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:05:58.540749 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40204.
May 06 12:05:58.993295 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:05:59.397177 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:05:59.442666 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:59.444974 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:59.570376 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:59.570962 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:59.571537 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:59.571941 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:59.615434 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Getting quotas for project 512fb78e722d408594f3c77de79e06dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:05:59.626100 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Getting quotas for user 19fe9468e0db4a04815e485dc0ce7987 and project 512fb78e722d408594f3c77de79e06dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:05:59.652878 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] [instance: d10012b1-2f2e-4702-bf9c-33202bf7b11b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:05:59.656311 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:59.660266 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:59.672114 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] [instance: d10012b1-2f2e-4702-bf9c-33202bf7b11b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:05:59.674028 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:59.674687 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:05:59.742165 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:05:59.742165 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eee07f2d-00b1-4149-a298-b5882afc1b30 tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:10.209531 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:06:10.242305 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:10.242305 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:10.385872 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:10.385872 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:10.412059 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:10.412059 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:10.484055 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Getting quotas for project 16e945e2ddbc460aacbf9831f93bdc00. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:06:10.499763 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Getting quotas for user 1b90b94e624f4051a107ca6714b35147 and project 16e945e2ddbc460aacbf9831f93bdc00. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:06:10.533824 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] [instance: 4bfa62ab-df81-4ea9-a40e-dd35c62eb6b2] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:06:10.535008 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:10.535516 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:10.545715 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] [instance: 4bfa62ab-df81-4ea9-a40e-dd35c62eb6b2] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='98be3973-5f71-48e4-8d76-029013a05d28',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:06:10.547599 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:10.548222 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:10.613627 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:10.614691 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3f17b8a2-187d-48fd-9a18-f754bd5a011f tempest-AttachSCSIVolumeTestJSON-734275599 tempest-AttachSCSIVolumeTestJSON-734275599-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:23.423316 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:06:23.516924 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:23.520902 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:23.644874 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:23.646145 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:23.647946 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:23.648627 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:23.696978 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Getting quotas for project 6ebd85b870c24c15b04baab796ca97b8. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:06:23.706307 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Getting quotas for user 3619189c0e3e482bac5f752575120132 and project 6ebd85b870c24c15b04baab796ca97b8. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:06:23.732361 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] [instance: 1a397078-ce00-451c-8dfa-7c9bf7d16ede] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:06:23.735134 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:23.735911 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:23.746680 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] [instance: 1a397078-ce00-451c-8dfa-7c9bf7d16ede] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:06:23.748541 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:23.749721 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:23.812478 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:23.813106 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-502bf5f5-74a0-4fa3-8a7b-aed49aa03a88 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:33.662228 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:06:33.722666 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:33.723312 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:33.831571 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:33.832085 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:33.832948 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:33.833530 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:33.868984 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Getting quotas for project ffacc0a8abb14d15910dca33cfaffe89. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:06:33.881989 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Getting quotas for user eed6affbe42e4a22b38781c6b89659df and project ffacc0a8abb14d15910dca33cfaffe89. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:06:33.908175 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] [instance: 102216c3-bad1-4b8a-9f09-f959503130fd] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:06:33.909501 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:33.915748 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:33.923790 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] [instance: 102216c3-bad1-4b8a-9f09-f959503130fd] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:06:33.925518 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:33.926260 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:33.978189 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:33.979175 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e83b0aa1-3ee2-4f5e-9007-29bae6853b88 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:42.050250 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:06:42.119090 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:42.119746 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:42.275824 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:42.276229 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:42.277012 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:42.277927 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:42.353783 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Getting quotas for project 89cd65806f1647cda93998be409ab28d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:06:42.370513 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Getting quotas for user 8ebe18632d474d558cba7f901b5925ba and project 89cd65806f1647cda93998be409ab28d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:06:42.422041 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] [instance: 857363d4-5864-498c-91c1-a1117477679a] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:06:42.423037 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:42.423444 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:42.452370 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] [instance: 857363d4-5864-498c-91c1-a1117477679a] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:06:42.462573 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:42.463073 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:42.546830 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:42.547461 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34a05434-445f-452e-97a3-146ba7117f75 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:45.124577 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:06:47.127644 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:06:47.179154 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:47.179826 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:47.291106 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:47.291722 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:47.293433 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:47.294053 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:47.334029 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Getting quotas for project 89cd65806f1647cda93998be409ab28d. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:06:47.344086 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Getting quotas for user 8ebe18632d474d558cba7f901b5925ba and project 89cd65806f1647cda93998be409ab28d. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:06:47.364549 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] [instance: b839759d-d982-43a4-9151-47b4487f1e33] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:06:47.365847 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:47.366480 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:47.375998 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] [instance: b839759d-d982-43a4-9151-47b4487f1e33] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:06:47.378091 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:47.378620 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:47.433892 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:47.435019 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c7ca536b-e23c-4455-b6f0-8af9287b3c67 tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:50.645968 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:06:50.690415 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:50.691722 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:50.763257 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:50.764684 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:50.766036 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:50.766679 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:50.793823 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Getting quotas for project 89cd65806f1647cda93998be409ab28d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:06:50.819499 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Getting quotas for user 8ebe18632d474d558cba7f901b5925ba and project 89cd65806f1647cda93998be409ab28d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:06:50.850444 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] [instance: a641c368-a356-4445-b3db-83d83cc56e49] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:06:50.851574 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:50.852380 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:50.865460 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] [instance: a641c368-a356-4445-b3db-83d83cc56e49] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:06:50.867459 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:50.868137 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:06:50.932863 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:06:50.933678 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a17a2628-b6aa-416a-a925-83d1406d373b tempest-ListServerFiltersTestJSON-308783824 tempest-ListServerFiltersTestJSON-308783824-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:08.154485 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:07:08.231074 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:08.240453 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:08.402096 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:08.411143 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:08.413217 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:08.414104 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:08.475048 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:07:08.487332 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for user d64804a5216f4c41a3b6473ada11fdca and project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:07:08.529266 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: e9eccf25-e324-4ab2-885e-d1f7e2ab183b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:07:08.532337 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:08.535685 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:08.557483 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: e9eccf25-e324-4ab2-885e-d1f7e2ab183b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:07:08.560182 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:08.561144 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:08.647599 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:08.648681 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-ee26f10c-e1e9-41e6-b16d-978da6d8f287 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:38.224394 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:07:38.350723 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:38.351330 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:38.423661 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:38.424329 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:38.425368 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:38.425909 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:38.444595 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:07:38.450197 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for user f1c6cf8cf1ee4ce6acb1f3c3b196af39 and project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:07:38.471800 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: b596b918-3566-4f5f-8de7-1983720fdf06] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:07:38.473675 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:38.474406 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:38.488432 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: b596b918-3566-4f5f-8de7-1983720fdf06] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:07:38.490053 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:38.490631 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:38.549232 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:07:38.550002 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92ae81ca-f91e-44ae-ad77-87cf269a3bb2 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:07:45.925268 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:07:46.943894 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42046.
May 06 12:08:04.298649 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:08:04.343161 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:04.343580 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:04.443110 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:04.443451 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:04.444250 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:04.444585 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:04.470086 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Getting quotas for project 6ebd85b870c24c15b04baab796ca97b8. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:08:04.477549 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Getting quotas for user 3619189c0e3e482bac5f752575120132 and project 6ebd85b870c24c15b04baab796ca97b8. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:08:04.494097 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] [instance: d7e6e5e4-076d-4104-9a2e-26160f747a47] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:08:04.495422 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:04.496034 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:04.508741 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] [instance: d7e6e5e4-076d-4104-9a2e-26160f747a47] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:08:04.510497 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:04.511146 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:04.576033 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:04.576452 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7635c3a6-bd1b-43d0-af85-803e929e46bd tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:22.843638 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:08:22.885892 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:22.886558 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:22.968737 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:22.969470 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:22.970965 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:22.971558 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:23.003616 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Getting quotas for project 512fb78e722d408594f3c77de79e06dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:08:23.012716 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Getting quotas for user 19fe9468e0db4a04815e485dc0ce7987 and project 512fb78e722d408594f3c77de79e06dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:08:23.031831 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] [instance: 0d9b370f-2df4-4f33-806f-9aeff9eded0e] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:08:23.033526 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:23.034186 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:23.044701 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] [instance: 0d9b370f-2df4-4f33-806f-9aeff9eded0e] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:08:23.047082 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:23.047804 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:23.095495 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:23.096189 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-aae06bb2-4a55-44b7-b21a-fd08a709474f tempest-ServerRescueNegativeTestJSON-693228248 tempest-ServerRescueNegativeTestJSON-693228248-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:46.926850 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:08:46.975645 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:46.980374 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:47.074907 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:47.075331 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:47.076297 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:47.076850 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:47.107233 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Getting quotas for project 3e037de393c5490fada3e21296f53579. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:08:47.114288 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Getting quotas for user e4f118223a644d29b549a5a3ee712eec and project 3e037de393c5490fada3e21296f53579. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:08:47.134914 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] [instance: 7234a7c5-be8f-41ff-9dfb-2f217e281f2c] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:08:47.136190 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:47.136775 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:47.165529 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] [instance: 7234a7c5-be8f-41ff-9dfb-2f217e281f2c] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:08:47.175323 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:47.176953 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:47.266816 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:47.267279 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-506cf56d-562f-4610-a32c-aa79face888b tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:58.539598 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:08:59.333211 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-e78e4ea8-ffe6-431a-9dd6-fd9672ef97cc tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:08:59.333853 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e78e4ea8-ffe6-431a-9dd6-fd9672ef97cc tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:08:59.334268 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-e78e4ea8-ffe6-431a-9dd6-fd9672ef97cc tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:08:59.370457 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-e78e4ea8-ffe6-431a-9dd6-fd9672ef97cc tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] [instance: 7234a7c5-be8f-41ff-9dfb-2f217e281f2c] No migration record for the rebuild/evacuate request. {{(pid=94344) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 12:08:59.378478 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e78e4ea8-ffe6-431a-9dd6-fd9672ef97cc tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] [f0de2a91-dfa1-48f0-9aa3-ff835f17d6cf] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer
May 06 12:08:59.549781 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43224.
May 06 12:09:00.430204 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [None req-e78e4ea8-ffe6-431a-9dd6-fd9672ef97cc tempest-ServerShowV254Test-347307743 tempest-ServerShowV254Test-347307743-project] [f0de2a91-dfa1-48f0-9aa3-ff835f17d6cf] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43246.
May 06 12:09:07.440421 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:09:07.507440 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:07.507860 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:07.685365 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:07.685652 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:07.686393 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:07.686794 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:07.771156 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:09:07.783071 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Getting quotas for user f1c6cf8cf1ee4ce6acb1f3c3b196af39 and project b3c6e519dfef4de3bdc038ce95e27458. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:09:07.813654 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: 477a1f4d-2e13-4730-8306-135f76032012] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:09:07.816361 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:07.818386 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:07.832880 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] [instance: 477a1f4d-2e13-4730-8306-135f76032012] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:09:07.837083 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:07.838794 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:07.929244 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:07.931483 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-509a39a7-5ab3-467f-b8bc-878765182cc4 tempest-DeleteServersTestJSON-1140932109 tempest-DeleteServersTestJSON-1140932109-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:15.762973 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:09:15.797304 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:15.798216 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:15.905093 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:15.906389 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:15.907784 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:15.908918 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:15.933212 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Getting quotas for project 6ebd85b870c24c15b04baab796ca97b8. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:09:15.939609 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Getting quotas for user 3619189c0e3e482bac5f752575120132 and project 6ebd85b870c24c15b04baab796ca97b8. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:09:15.977398 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] [instance: 3789f806-a3f7-4f4d-801b-198605b7ae6e] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:09:15.978625 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:15.979029 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:15.989637 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] [instance: 3789f806-a3f7-4f4d-801b-198605b7ae6e] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:09:15.990942 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:15.992028 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:16.035965 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:16.036901 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0fc3e1-abb6-4b03-bba0-470e311507a8 tempest-ImagesTestJSON-255594975 tempest-ImagesTestJSON-255594975-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:40.167616 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:09:40.231281 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:40.231281 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:40.301186 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:40.302328 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:40.303827 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:40.304761 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:40.340909 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Getting quotas for project ffacc0a8abb14d15910dca33cfaffe89. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:09:40.352987 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Getting quotas for user eed6affbe42e4a22b38781c6b89659df and project ffacc0a8abb14d15910dca33cfaffe89. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:09:40.384673 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] [instance: f1085f53-c9a8-4cd1-9279-50abec0e7d00] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:09:40.386267 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:40.386907 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:40.396806 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] [instance: f1085f53-c9a8-4cd1-9279-50abec0e7d00] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:09:40.399516 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:40.400147 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:09:40.486375 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:09:40.486990 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-7d8260f1-c926-47b3-a281-98a79493ebc6 tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:04.663916 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:10:04.723066 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:04.723922 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:04.810525 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:04.811195 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:04.812247 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:04.812873 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:04.834385 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Getting quotas for project dcb8a3d17c9741b4811d0a930c42c3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:10:04.842250 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Getting quotas for user bf4a256d05f84570859e1110a1cd7e13 and project dcb8a3d17c9741b4811d0a930c42c3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:10:04.871135 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] [instance: dbe67eb7-b52d-449e-a9ce-26649443e1d6] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:10:04.871135 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:04.873346 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:04.889072 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] [instance: dbe67eb7-b52d-449e-a9ce-26649443e1d6] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:10:04.893727 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:04.894536 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:04.968075 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:04.969087 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-83a2aa8e-66bb-4ec7-9395-d26cbd20d48f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:05.138159 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:10:24.042055 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:10:24.074646 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:24.075556 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:24.156812 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:24.157995 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:24.161756 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:24.162462 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:24.190899 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Getting quotas for project 2448795a3e53444dbdd9413576ac9087. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:10:24.197501 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Getting quotas for user 48c8ef5b6cf34143aa8340b044df52d6 and project 2448795a3e53444dbdd9413576ac9087. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:10:24.243669 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] [instance: 8b192a20-32e3-4d26-b495-9104bfd5ae49] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:10:24.245362 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:24.252879 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:24.276435 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] [instance: 8b192a20-32e3-4d26-b495-9104bfd5ae49] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:10:24.286371 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:24.289962 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:24.382217 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:24.384203 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-e77e7c56-eb0e-4277-a5d5-bb8b93be9841 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:25.981591 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:10:26.058255 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:26.062714 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:26.179757 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:26.180935 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:26.186078 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:26.187117 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:26.226138 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Getting quotas for project 2448795a3e53444dbdd9413576ac9087. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:10:26.240400 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Getting quotas for user 48c8ef5b6cf34143aa8340b044df52d6 and project 2448795a3e53444dbdd9413576ac9087. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:10:26.285560 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] [instance: 88bc318a-7fcf-4289-892f-0740a9af7ffc] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:10:26.288554 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:26.294553 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:26.340359 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] [instance: 88bc318a-7fcf-4289-892f-0740a9af7ffc] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:10:26.346239 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:26.355141 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:26.504927 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:10:26.507309 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cd97813-cece-4532-8f7d-bf92a1f909a5 tempest-ListImageFiltersTestJSON-511989841 tempest-ListImageFiltersTestJSON-511989841-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:10:46.944806 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:10:47.958129 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 45414.
May 06 12:11:11.278535 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Took 1.39 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:11:11.365459 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:11.366140 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:11.459501 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:11.459808 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:11.460620 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:11.461209 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:11.495495 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:11:11.501938 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for user d64804a5216f4c41a3b6473ada11fdca and project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:11:11.521976 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: 971c4c95-7dd7-48d2-bd72-f24e44095dcb] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:11:11.523524 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:11.523997 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:11.536313 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: 971c4c95-7dd7-48d2-bd72-f24e44095dcb] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:11:11.538949 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:11.539535 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:11.609999 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:11.610442 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-4663845a-3f96-4b6d-9c4d-1684ad2d1562 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:28.294772 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:11:28.426926 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:28.432493 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:28.706795 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:28.708404 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:28.714395 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:28.716276 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:28.822744 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Getting quotas for project dcb8a3d17c9741b4811d0a930c42c3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:11:28.842540 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Getting quotas for user bf4a256d05f84570859e1110a1cd7e13 and project dcb8a3d17c9741b4811d0a930c42c3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:11:28.919261 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] [instance: eaf8edba-e8db-4b20-a2a0-93d138dba8e7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:11:28.920830 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:28.931782 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:28.946511 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] [instance: eaf8edba-e8db-4b20-a2a0-93d138dba8e7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:11:28.949207 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:28.950074 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:29.067478 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:29.069646 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-48fa3017-5acd-4c23-9283-f33fcf0b6b8b tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:54.550946 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:11:54.599204 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:54.600096 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:54.684974 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:54.685787 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:54.686789 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:54.687411 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:54.710754 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:11:54.718947 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Getting quotas for user d64804a5216f4c41a3b6473ada11fdca and project bd4fe4c5d88a4a9581db028fd1be3113. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:11:54.733190 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: 7b50e938-e912-4901-b3ff-9e0fedf16bb5] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:11:54.734597 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:54.735242 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:54.746006 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] [instance: 7b50e938-e912-4901-b3ff-9e0fedf16bb5] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:11:54.747882 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:54.749615 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:54.819913 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:11:54.821363 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-18e5a804-eecc-4c00-bb40-9c0a918e1213 tempest-ServerActionsTestJSON-835738327 tempest-ServerActionsTestJSON-835738327-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:11:59.550467 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:12:00.566062 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 47190.
May 06 12:12:07.748212 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:12:07.796316 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:07.798300 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:07.919236 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:07.919720 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:07.920572 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:07.921072 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:07.970250 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Getting quotas for project ba329c8b65ed4fc283f6bd64c29e4a3a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:12:07.984632 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Getting quotas for user 16adae1fa9a24961bc6e1311ae8bf2ba and project ba329c8b65ed4fc283f6bd64c29e4a3a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:12:08.006681 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] [instance: c6f6cd22-2722-4e90-b506-9b1d9749238b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:12:08.008049 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:08.013204 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:08.024824 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] [instance: c6f6cd22-2722-4e90-b506-9b1d9749238b] block_device_mapping [BlockDeviceMapping(attachment_id=690cff64-f71d-403d-ad8c-efd8a3287658,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=<?>,uuid=<?>,volume_id='6dc7cd35-7c4c-4fbd-8664-64a4aea1b900',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=d5d15a15-4b75-4310-8dcb-c6dcd58de01f,boot_index=1,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=<?>,uuid=<?>,volume_id='2b07ba90-d229-4d0a-82a4-c19fd1330b22',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=62495f7e-d8bf-468b-9aee-cb8cba5ba854,boot_index=2,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='76fc2293-f275-4f66-86b5-f36f8b224205',volume_size=1,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:12:08.027100 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:08.027833 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:08.047212 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:08.047923 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:08.059367 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:08.060053 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:08.114103 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:08.114806 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7f4f1609-5606-44d3-a027-c3613de694e1 tempest-TaggedBootDevicesTest_v242-1119644642 tempest-TaggedBootDevicesTest_v242-1119644642-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:28.338825 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:12:28.396763 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:28.397907 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:28.511939 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:28.513529 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:28.515331 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:28.518038 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:28.559549 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Getting quotas for project dcb8a3d17c9741b4811d0a930c42c3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:12:28.571448 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Getting quotas for user bf4a256d05f84570859e1110a1cd7e13 and project dcb8a3d17c9741b4811d0a930c42c3cf. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:12:28.597743 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] [instance: f1bf2891-e5f5-4cc9-b61a-b8c33cdc6bf2] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:12:28.600145 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:28.602114 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:28.615010 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] [instance: f1bf2891-e5f5-4cc9-b61a-b8c33cdc6bf2] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:12:28.616648 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:28.618623 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:28.683172 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:28.683887 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-08b2095c-057d-432b-b511-de26037df79f tempest-ImagesOneServerNegativeTestJSON-950791646 tempest-ImagesOneServerNegativeTestJSON-950791646-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:51.838464 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:12:52.007364 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:52.007856 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:52.242325 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:52.243489 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:52.245145 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:52.246527 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:52.292735 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Getting quotas for project ffacc0a8abb14d15910dca33cfaffe89. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:12:52.307083 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Getting quotas for user eed6affbe42e4a22b38781c6b89659df and project ffacc0a8abb14d15910dca33cfaffe89. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:12:52.347252 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] [instance: 5661dfa5-e192-42f1-b164-54b36f1bc104] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:12:52.351580 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:52.354062 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:52.384202 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] [instance: 5661dfa5-e192-42f1-b164-54b36f1bc104] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:12:52.401947 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:52.403150 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:12:52.562602 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:12:52.563719 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9ed2e1c4-edd0-4c87-8e6e-7388e2b7d42e tempest-AttachVolumeNegativeTest-1123230460 tempest-AttachVolumeNegativeTest-1123230460-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:13:25.148237 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:13:47.958791 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:13:48.971619 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 49418.
May 06 12:14:03.037799 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:14:03.095832 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:03.096434 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:03.288266 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:03.288948 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:03.289957 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:03.290805 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:03.372198 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Getting quotas for project 89b9e87da57a4ca2ae3d45391746e3b7. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:14:03.382074 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Getting quotas for user 8f7626cc0e0d4cc2a355a83225307b41 and project 89b9e87da57a4ca2ae3d45391746e3b7. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:14:03.418947 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] [instance: 08e133d3-6f9a-49a5-8510-d9fc2f45fbc5] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:14:03.421272 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:03.422930 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:03.486550 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] [instance: 08e133d3-6f9a-49a5-8510-d9fc2f45fbc5] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:14:03.501285 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:03.511629 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:03.621031 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:03.621758 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0395151a-8b5e-4e09-bccd-872b226ce4a0 tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:17.705445 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:14:17.743252 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:17.743765 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:17.878338 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:17.879135 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:17.882166 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:17.882984 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:17.933197 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Getting quotas for project 056de73995644f36bbf3059d03b8dd0e. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:14:17.941336 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Getting quotas for user 5439799068b8406ebe966ed8e399d194 and project 056de73995644f36bbf3059d03b8dd0e. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:14:17.980139 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] [instance: 0cd732f2-dede-4a2e-8693-b3d8d9aab04d] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:14:17.981803 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:17.983763 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:17.995940 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] [instance: 0cd732f2-dede-4a2e-8693-b3d8d9aab04d] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:14:17.998053 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:17.998565 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:18.092546 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:18.093306 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6c062105-242b-4eb1-b528-e6b8a06db250 tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:19.012775 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:14:20.712653 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:14:20.763227 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:20.763900 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:20.851815 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:20.852255 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:20.853146 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:20.853719 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:20.883038 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Getting quotas for project 056de73995644f36bbf3059d03b8dd0e. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:14:20.892825 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Getting quotas for user 5439799068b8406ebe966ed8e399d194 and project 056de73995644f36bbf3059d03b8dd0e. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:14:20.914711 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] [instance: ee195dfb-e65a-4349-b94e-c0b09dcc9c05] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:14:20.916945 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:20.917973 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:20.934544 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] [instance: ee195dfb-e65a-4349-b94e-c0b09dcc9c05] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:14:20.937498 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:20.938440 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:21.005925 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:21.006961 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f193b8a4-d6e6-42ab-b6ed-9fa12dc0a60b tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:22.378369 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:14:22.446399 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:22.447738 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:22.627374 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:22.628182 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:22.629441 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:22.630210 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:22.683630 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Getting quotas for project 41f27b15f11747ecb2f6f494977d8066. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:14:22.695274 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Getting quotas for user cf942a57f2294ba2a39e1eace71d5513 and project 41f27b15f11747ecb2f6f494977d8066. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:14:22.719881 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] [instance: 51518f10-a9cf-4b20-be0b-2f6ca402accd] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:14:22.721738 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:22.722220 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:22.739075 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] [instance: 51518f10-a9cf-4b20-be0b-2f6ca402accd] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:14:22.746830 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:22.747630 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:22.815391 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:22.816018 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3fb525a4-79a3-4b89-95e5-340f5137dfd4 tempest-InstanceActionsNegativeTestJSON-547592467 tempest-InstanceActionsNegativeTestJSON-547592467-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:30.635823 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fc2f3761-8f8d-4501-96c3-483e2bec3dfd tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:14:30.639510 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2f3761-8f8d-4501-96c3-483e2bec3dfd tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:14:30.639926 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2f3761-8f8d-4501-96c3-483e2bec3dfd tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:14:30.672335 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fc2f3761-8f8d-4501-96c3-483e2bec3dfd tempest-ServerShowV247Test-423577227 tempest-ServerShowV247Test-423577227-project] [instance: ee195dfb-e65a-4349-b94e-c0b09dcc9c05] No migration record for the rebuild/evacuate request. {{(pid=94343) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 12:15:00.568287 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:15:01.582693 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 50346.
May 06 12:15:17.443734 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:15:17.490885 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:17.491723 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:17.587049 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:17.587901 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:17.589062 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:17.589717 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:17.618678 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Getting quotas for project 89b9e87da57a4ca2ae3d45391746e3b7. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:15:17.625303 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Getting quotas for user 8f7626cc0e0d4cc2a355a83225307b41 and project 89b9e87da57a4ca2ae3d45391746e3b7. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:15:17.643178 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] [instance: d37a2c50-b854-43f7-8ba8-109bfef814a1] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:15:17.644155 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:17.644787 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:17.654206 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] [instance: d37a2c50-b854-43f7-8ba8-109bfef814a1] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:15:17.656012 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:17.656423 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:17.721936 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:17.722330 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2f6ed659-6b04-4d67-9772-343c7a9f0fba tempest-SecurityGroupsTestJSON-809665574 tempest-SecurityGroupsTestJSON-809665574-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:20.603535 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:15:20.701276 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:20.701695 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:20.843572 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:20.847094 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:20.850146 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:20.851270 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:20.938043 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Getting quotas for project 32352b806d8c49e38cfcf0ceb12343d0. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:15:20.952520 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Getting quotas for user a31243716996487883ad424455a03af2 and project 32352b806d8c49e38cfcf0ceb12343d0. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:15:20.978396 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] [instance: d8bbb80e-2136-4eae-af3c-d92ef226b5ad] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:15:20.979391 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:20.979808 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:20.998288 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] [instance: d8bbb80e-2136-4eae-af3c-d92ef226b5ad] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:15:20.999683 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:21.000120 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:21.058041 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:21.058392 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d60df1ba-000e-4709-b284-be3659a3cca9 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:37.403823 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:15:37.448186 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:37.448710 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:37.559009 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:37.559404 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:37.560591 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:37.561246 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:37.621732 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Getting quotas for project 7f5a6eb7760d46e2b5c319c7ec7ea687. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:15:37.637042 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Getting quotas for user b0200a8d9c8c4f8d8f1eb747e66d590e and project 7f5a6eb7760d46e2b5c319c7ec7ea687. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:15:37.666060 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] [instance: 2e30672d-21ef-4599-8d72-93a1279f9f68] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:15:37.667568 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:37.668212 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:37.683599 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] [instance: 2e30672d-21ef-4599-8d72-93a1279f9f68] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:15:37.690572 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:37.690895 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:37.789859 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:37.790799 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-cc0d100d-de76-44a8-98df-6245af3b7711 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:48.420104 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-424eb866-9717-4c2e-8f8a-bd9923c38368 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:15:48.424836 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-424eb866-9717-4c2e-8f8a-bd9923c38368 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:48.427628 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-424eb866-9717-4c2e-8f8a-bd9923c38368 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:48.471650 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-424eb866-9717-4c2e-8f8a-bd9923c38368 tempest-ServerShowV257Test-911813709 tempest-ServerShowV257Test-911813709-project] [instance: 2e30672d-21ef-4599-8d72-93a1279f9f68] No migration record for the rebuild/evacuate request. {{(pid=94343) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 12:15:51.491679 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:51.492875 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:52.095414 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:15:52.152135 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:52.154665 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:52.266735 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:52.269753 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:52.270885 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:52.271455 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:52.316048 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Getting quotas for project 0920ee808fdd4dbeb1487dc088f40561. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:15:52.326209 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Getting quotas for user e4e123f30a4642f697bb36612d21ca9f and project 0920ee808fdd4dbeb1487dc088f40561. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:15:52.359060 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] [instance: 110db96a-345e-463c-a73c-b57e48402fb6] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:15:52.360250 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:52.360806 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:52.372296 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] [instance: 110db96a-345e-463c-a73c-b57e48402fb6] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:15:52.377828 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:52.381239 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:15:52.488077 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:15:52.488769 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4754c131-56ae-4a0f-b1a7-0a61f5ea1839 tempest-ServerGroupTestJSON-1950882593 tempest-ServerGroupTestJSON-1950882593-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:16:01.191371 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:16:01.283904 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:16:01.285383 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:16:01.493901 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:16:01.494513 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:16:01.495744 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:16:01.496356 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:16:01.618588 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Getting quotas for project 32352b806d8c49e38cfcf0ceb12343d0. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:16:01.632431 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Getting quotas for user a31243716996487883ad424455a03af2 and project 32352b806d8c49e38cfcf0ceb12343d0. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:16:01.692335 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] [instance: f2fe4e41-bdb7-491a-b514-f82385d50c71] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:16:01.694110 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:16:01.694832 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:16:01.741420 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] [instance: f2fe4e41-bdb7-491a-b514-f82385d50c71] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:16:01.749587 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:16:01.750221 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:16:01.827207 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:16:01.827802 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d246e5c2-cc24-4521-86b3-7d15dbb3e68c tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:16:48.987289 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:16:49.987647 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51760.
May 06 12:17:39.023470 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:17:46.857651 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Took 2.25 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:17:46.898291 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:17:46.899378 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:17:47.002832 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:17:47.007486 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:17:47.008504 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:17:47.010699 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:17:47.062285 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Getting quotas for project 74b9adae05414fa99c02dd2c9fa41587. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:17:47.075414 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Getting quotas for user 8f0182ad740c455c9a5ca3c6622e03ae and project 74b9adae05414fa99c02dd2c9fa41587. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:17:47.111812 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] [instance: c1c558fb-c366-4ea7-872e-0d77c1a73131] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:17:47.114314 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:17:47.115555 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:17:47.131321 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] [instance: c1c558fb-c366-4ea7-872e-0d77c1a73131] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:17:47.134864 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:17:47.135335 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:17:47.220990 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:17:47.223989 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5cc1b683-cc2e-4f6c-9f60-5cafbff507fd tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:18:01.580568 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:18:02.591901 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 53224.
May 06 12:18:25.164372 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:18:29.262457 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:18:30.284575 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 53766.
May 06 12:18:39.433188 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:18:39.490725 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:18:39.491137 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:18:39.591990 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:18:39.601774 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:18:39.608804 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:18:39.610099 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:18:39.683306 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Getting quotas for project 698db820686f4b4d9ad3be6d048415ed. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:18:39.699357 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Getting quotas for user d3ba623ada8942a88c4caf9f86ffed1a and project 698db820686f4b4d9ad3be6d048415ed. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:18:39.718974 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] [instance: 1f176b59-c4a4-4d70-857f-b138f0d0b211] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:18:39.719964 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:18:39.720370 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:18:39.736013 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] [instance: 1f176b59-c4a4-4d70-857f-b138f0d0b211] block_device_mapping [BlockDeviceMapping(attachment_id=0cb15002-0745-4d6e-b610-599f57b219f3,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='82d549a9-39d8-4f00-977f-12995c52fc5d',volume_size=1,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:18:39.737862 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:18:39.738552 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:18:39.801619 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:18:39.802708 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f90b9084-9668-4283-9d38-1e779b3637e8 tempest-ServersTestBootFromVolume-873121424 tempest-ServersTestBootFromVolume-873121424-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:18:52.369619 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:18:53.381674 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 54056.
May 06 12:19:49.994327 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:19:51.036618 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 54810.
May 06 12:20:27.874583 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-04995c52-dedc-4f58-81e7-98c8073d5506 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method unshelve_instance {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:20:27.875639 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-04995c52-dedc-4f58-81e7-98c8073d5506 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:20:27.877490 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-04995c52-dedc-4f58-81e7-98c8073d5506 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:20:29.797540 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-04995c52-dedc-4f58-81e7-98c8073d5506 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] [instance: d8bbb80e-2136-4eae-af3c-d92ef226b5ad] Requesting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) during scheduling {{(pid=94343) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}}
May 06 12:20:30.409560 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-04995c52-dedc-4f58-81e7-98c8073d5506 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:20:30.445610 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance [None req-04995c52-dedc-4f58-81e7-98c8073d5506 tempest-ServersNegativeTestJSON-725750365 tempest-ServersNegativeTestJSON-725750365-project] Lazy-loading 'flavor' on Instance uuid d8bbb80e-2136-4eae-af3c-d92ef226b5ad {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 12:20:49.039198 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Took 0.83 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:20:49.106146 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:20:49.107580 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:20:49.346438 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:20:49.348151 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:20:49.355579 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:20:49.356326 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:20:49.447901 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Getting quotas for project 129745338a8d431d95a5bdee45487979. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:20:49.469555 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Getting quotas for user 97df61612e034c1b95b644a570b5d062 and project 129745338a8d431d95a5bdee45487979. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:20:49.554654 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] [instance: f87deae6-057b-42b0-b275-b909d316e224] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:20:49.569803 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:20:49.570673 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:20:49.588638 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] [instance: f87deae6-057b-42b0-b275-b909d316e224] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:20:49.590885 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:20:49.591548 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:20:49.705939 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:20:49.708602 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-1df02dcf-4172-48c9-b5fe-92e995b97f2f tempest-InstanceActionsV221TestJSON-1508144431 tempest-InstanceActionsV221TestJSON-1508144431-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:20:59.037272 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:21:02.592192 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:21:03.611402 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 55724.
May 06 12:21:45.180013 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:22:04.491626 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:22:04.549679 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:04.549936 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:04.667963 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:04.668392 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:04.669872 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:04.670297 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:04.720659 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Getting quotas for project 7390cd27418749f79385813a1dbf75e0. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:22:04.730994 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Getting quotas for user e26b832a70dd4905a61cfd50ea89fa8a and project 7390cd27418749f79385813a1dbf75e0. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:22:04.764286 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] [instance: 16157c87-eef6-491c-8c76-eeffcfa8637f] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:22:04.765866 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:04.766489 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:04.795110 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] [instance: 16157c87-eef6-491c-8c76-eeffcfa8637f] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:22:04.797525 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:04.798421 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:04.856600 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:04.857650 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a50216f6-7f1e-45a5-a3c2-05a150cca689 tempest-ServerPasswordTestJSON-1214741716 tempest-ServerPasswordTestJSON-1214741716-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:13.940359 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:22:14.003987 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:14.005329 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:14.196304 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:14.200306 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:14.208747 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:14.209587 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:14.290257 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Getting quotas for project 53bd8767e60345e8b0b132db7c9cc2a4. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:22:14.313214 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Getting quotas for user 59d7c242f85f4ac28d231760c7b23cc9 and project 53bd8767e60345e8b0b132db7c9cc2a4. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:22:14.348766 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] [instance: a36672b7-f3d2-4fb4-90b5-e313c7c12abf] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:22:14.358162 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:14.359023 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:14.380067 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] [instance: a36672b7-f3d2-4fb4-90b5-e313c7c12abf] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:22:14.383223 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:14.384259 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:14.500643 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:14.501343 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-506e12aa-48f2-4aa7-8bf5-e84db5144236 tempest-ServersTestManualDisk-1582458365 tempest-ServersTestManualDisk-1582458365-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:44.395370 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:22:44.457271 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:44.458628 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:44.572820 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:44.573639 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:44.574966 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:44.575732 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:44.598697 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Getting quotas for project 727a39dae7794f9c9c5175257f9fee39. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:22:44.604580 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Getting quotas for user a3b5cad694bd451686e98cc124961c6b and project 727a39dae7794f9c9c5175257f9fee39. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:22:44.621741 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] [instance: 99c5fb5e-d5bb-4a58-bc57-8eeb9e71b886] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:22:44.623846 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:44.624461 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:44.638326 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] [instance: 99c5fb5e-d5bb-4a58-bc57-8eeb9e71b886] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:22:44.640596 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:44.641254 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:44.690993 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:22:44.691920 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-2a8f0204-7893-4ce5-b859-939820919f7c tempest-ServersNegativeTestMultiTenantJSON-2064025065 tempest-ServersNegativeTestMultiTenantJSON-2064025065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:22:51.016943 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:22:52.027296 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 58354.
May 06 12:24:03.607642 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:24:04.618419 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 60762.
May 06 12:24:19.071786 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:24:29.246014 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:24:30.317614 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 33168.
May 06 12:24:47.834686 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Took 3.16 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:24:47.920015 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:24:47.939498 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:24:48.085482 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:24:48.088475 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:24:48.092665 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:24:48.095927 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:24:48.177854 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Getting quotas for project 74b9adae05414fa99c02dd2c9fa41587. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:24:48.200967 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Getting quotas for user 8f0182ad740c455c9a5ca3c6622e03ae and project 74b9adae05414fa99c02dd2c9fa41587. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:24:48.244682 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] [instance: f4541882-6000-4ce2-b38a-433e1b4b8400] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:24:48.249247 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:24:48.249683 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:24:48.268139 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] [instance: f4541882-6000-4ce2-b38a-433e1b4b8400] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:24:48.272027 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:24:48.273339 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:24:48.355303 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:24:48.355972 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-5791a845-8a72-4fb3-9d1a-07912fd36a1f tempest-AttachVolumeTestJSON-1791089882 tempest-AttachVolumeTestJSON-1791089882-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:24:49.883264 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:24:49.918910 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:24:50.891823 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 33656.
May 06 12:24:51.133487 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:25:05.196347 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:25:14.797283 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Took 1.29 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:25:14.953449 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:25:14.961472 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:25:15.348503 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:25:15.354184 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:25:15.360989 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:25:15.362769 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:25:15.525877 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Getting quotas for project 207a2809ab9e4c778501c3cca291298a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:25:15.542673 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Getting quotas for user 270cea8104114567bdec7dc5e8cd6308 and project 207a2809ab9e4c778501c3cca291298a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:25:15.581710 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [instance: efd9c31f-ee88-4e5c-98ca-c50feebeb5b5] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:25:15.581710 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:25:15.581710 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:25:15.609525 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [instance: efd9c31f-ee88-4e5c-98ca-c50feebeb5b5] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:25:15.628608 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:25:15.628608 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:25:15.781854 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:25:15.783901 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-6576f0f2-de63-40b4-8b9a-9ef7f683c759 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:25:50.099211 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b6ba33eb-ebb6-441c-83ac-66d2d7c616cd tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:25:50.099211 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6ba33eb-ebb6-441c-83ac-66d2d7c616cd tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:25:50.125997 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6ba33eb-ebb6-441c-83ac-66d2d7c616cd tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:25:50.269594 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b6ba33eb-ebb6-441c-83ac-66d2d7c616cd tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [instance: efd9c31f-ee88-4e5c-98ca-c50feebeb5b5] No migration record for the rebuild/evacuate request. {{(pid=94343) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 12:25:52.036816 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:25:53.083601 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 35088.
May 06 12:26:20.580356 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:26:20.644732 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:20.645314 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:20.755039 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:20.756878 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:20.759883 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:20.768816 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:20.811158 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Getting quotas for project 678504ad13f741c68d305c41b69c6745. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:26:20.823577 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Getting quotas for user eccf93541d59437b947dd9ec6935e16f and project 678504ad13f741c68d305c41b69c6745. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:26:20.864886 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] [instance: a6eb3a38-2ff3-4537-817a-71e56044f9d7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:26:20.866296 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:20.867206 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:20.879256 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] [instance: a6eb3a38-2ff3-4537-817a-71e56044f9d7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:26:20.881247 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:20.882272 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:20.953745 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:20.954462 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7e3b0491-6d71-4cb3-a3cb-d46be9d3b3fc tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:40.161408 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:26:40.215208 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:40.215974 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:40.290861 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:40.291499 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:40.292542 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:40.293052 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:40.314992 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Getting quotas for project 029cbc9bfae44308bd41519e95313e77. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:26:40.323290 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Getting quotas for user 4982e8bdfe99442a926c1561c96901c7 and project 029cbc9bfae44308bd41519e95313e77. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:26:40.340541 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] [instance: 489b5bb9-ee4c-4028-8302-2d87e98a1499] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:26:40.341875 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:40.342595 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:40.362634 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] [instance: 489b5bb9-ee4c-4028-8302-2d87e98a1499] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:26:40.368527 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:40.372325 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:40.435369 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:40.436012 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a7c76774-26e6-40d7-968e-222141bc098a tempest-VolumesActionsTest-576055241 tempest-VolumesActionsTest-576055241-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:49.686912 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:26:49.791697 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:49.792361 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:49.893948 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:49.897984 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:49.912939 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:49.913393 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:49.967319 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Getting quotas for project 207a2809ab9e4c778501c3cca291298a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:26:49.981834 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Getting quotas for user 270cea8104114567bdec7dc5e8cd6308 and project 207a2809ab9e4c778501c3cca291298a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:26:50.016621 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [instance: fd32da91-397c-4e87-afd5-cf29194aa454] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:26:50.023199 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:50.023704 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:50.038420 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [instance: fd32da91-397c-4e87-afd5-cf29194aa454] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:26:50.041203 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:50.042232 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:26:50.102390 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:26:50.105285 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-b0a89dd9-946e-4af5-baa0-62770d7442ad tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:27:03.511221 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:27:03.552841 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:27:03.553335 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:27:03.642482 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:27:03.643250 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:27:03.644456 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:27:03.645396 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:27:03.678190 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Getting quotas for project 678504ad13f741c68d305c41b69c6745. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:27:03.688223 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Getting quotas for user eccf93541d59437b947dd9ec6935e16f and project 678504ad13f741c68d305c41b69c6745. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:27:03.711974 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] [instance: ed39be8c-01ef-42eb-8dc1-124842114d0a] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:27:03.714087 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:27:03.714916 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:27:03.731096 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] [instance: ed39be8c-01ef-42eb-8dc1-124842114d0a] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:27:03.733530 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:27:03.734167 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:27:03.857373 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:27:03.869950 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-eba54e93-dfea-4545-a7ae-30bf0d8b6b45 tempest-VolumesActionsTest-786430008 tempest-VolumesActionsTest-786430008-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:27:04.622219 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:27:05.639330 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37594.
May 06 12:27:30.684768 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-dc687c76-60df-4da6-b36d-aa7bbbf3c04c tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:27:30.685936 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-dc687c76-60df-4da6-b36d-aa7bbbf3c04c tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:27:30.686322 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-dc687c76-60df-4da6-b36d-aa7bbbf3c04c tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:27:30.734604 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-dc687c76-60df-4da6-b36d-aa7bbbf3c04c tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [instance: fd32da91-397c-4e87-afd5-cf29194aa454] No migration record for the rebuild/evacuate request. {{(pid=94344) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 12:27:30.741006 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dc687c76-60df-4da6-b36d-aa7bbbf3c04c tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [f0de2a91-dfa1-48f0-9aa3-ff835f17d6cf] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer
May 06 12:27:31.750827 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [None req-dc687c76-60df-4da6-b36d-aa7bbbf3c04c tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [f0de2a91-dfa1-48f0-9aa3-ff835f17d6cf] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38488.
May 06 12:28:11.368115 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:28:11.458132 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:11.459349 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:11.642430 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:11.649755 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:11.650820 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:11.654214 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:11.717494 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Getting quotas for project 207a2809ab9e4c778501c3cca291298a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:28:11.741167 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Getting quotas for user 270cea8104114567bdec7dc5e8cd6308 and project 207a2809ab9e4c778501c3cca291298a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:28:11.817824 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [instance: e74e3522-b8ad-44d5-95cf-d634fde22418] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:28:11.820303 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:11.820942 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:11.855900 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] [instance: e74e3522-b8ad-44d5-95cf-d634fde22418] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:28:11.862221 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:11.863323 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:12.060350 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:12.063139 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-99363eb0-df44-443e-abab-3fd3938e8a53 tempest-ServerDiskConfigTestJSON-1073068398 tempest-ServerDiskConfigTestJSON-1073068398-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:14.930371 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Took 1.20 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:28:15.047329 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:15.053984 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:15.220237 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:15.226734 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:15.228580 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:15.229616 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:15.301631 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Getting quotas for project 2207b5edc4da4745ad9c61c753911f95. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:28:15.328607 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Getting quotas for user b1500322c9de4fd9a66a3ca0b09f1d00 and project 2207b5edc4da4745ad9c61c753911f95. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:28:15.381453 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] [instance: 0d6ef98d-8bd8-4ca9-988e-1915ad8417e7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:28:15.389512 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:15.390735 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:15.411350 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] [instance: 0d6ef98d-8bd8-4ca9-988e-1915ad8417e7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:28:15.413748 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:15.422129 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:15.645416 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:28:15.648164 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ef2185cd-a5f2-4d4e-8386-6e75d9da89b7 tempest-VolumesBackupsTest-985186075 tempest-VolumesBackupsTest-985186075-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:28:25.206808 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:28:53.066418 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:28:54.082500 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 39970.
May 06 12:29:34.764170 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:29:34.887568 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:29:34.888279 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:29:34.992726 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:29:34.993468 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:29:34.994452 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:29:34.995048 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:29:35.053925 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Getting quotas for project 46cdee0b98514d42a1a08b20d67ccb54. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:29:35.068793 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Getting quotas for user 0816773074ef42688c0f56bf71781ca6 and project 46cdee0b98514d42a1a08b20d67ccb54. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:29:35.108283 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] [instance: cdd94b20-b2cb-4260-a513-0ba243bbbb19] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:29:35.109345 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:29:35.109758 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:29:35.135484 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] [instance: cdd94b20-b2cb-4260-a513-0ba243bbbb19] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:29:35.136753 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:29:35.137171 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:29:35.216730 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:29:35.217092 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-cbe74378-c53c-4a3b-a029-83df942ac0bf tempest-ServersAaction247Test-57739296 tempest-ServersAaction247Test-57739296-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:30:05.638171 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:30:06.648485 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42094.
May 06 12:30:09.432223 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Took 1.07 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:30:09.503841 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:30:09.504560 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:30:09.798057 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:30:09.805486 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:30:09.814397 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:30:09.814810 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:30:09.910055 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Getting quotas for project e63614b18dbe41679ccc9498057f75fe. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:30:09.930591 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Getting quotas for user adc22daa12684048b7fce70327e5b8b6 and project e63614b18dbe41679ccc9498057f75fe. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:30:09.981241 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] [instance: cfae78ed-74ae-4e9f-beb7-532e948903cc] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:30:09.994286 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:30:09.994679 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:30:10.010185 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] [instance: cfae78ed-74ae-4e9f-beb7-532e948903cc] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:30:10.011811 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:30:10.013194 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:30:10.099794 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:30:10.100586 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-998f5612-c3f8-4bc3-a8c0-ab1206e891c0 tempest-ServerAddressesTestJSON-1412503891 tempest-ServerAddressesTestJSON-1412503891-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:31:16.391115 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Took 1.02 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:31:16.481727 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:31:16.482260 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:31:16.628073 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:31:16.629812 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:31:16.632471 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:31:16.633614 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:31:16.729300 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Getting quotas for project f19d5f701c93477a863f9aee61d42db7. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:31:16.742352 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Getting quotas for user c9f794105dc04921b95eb4477a6c1697 and project f19d5f701c93477a863f9aee61d42db7. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:31:16.771984 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] [instance: d0959f00-4865-47b6-803c-964877c6d56f] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:31:16.775470 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:31:16.780085 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:31:16.800580 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] [instance: d0959f00-4865-47b6-803c-964877c6d56f] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:31:16.803875 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:31:16.804573 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:31:16.879970 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:31:16.881047 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-593bb7ba-b934-4358-9243-bc39bd10cf3f tempest-ServerTagsTestJSON-1204398385 tempest-ServerTagsTestJSON-1204398385-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:31:45.227377 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:31:54.081808 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:31:55.092468 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 45230.
May 06 12:32:26.297256 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:32:26.353514 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:32:26.354262 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:32:26.509272 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:32:26.510082 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:32:26.511349 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:32:26.512086 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:32:26.580507 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:32:26.603033 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for user fecb0beba56547439cb6c69675b1bab5 and project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:32:26.632323 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 90bc9ddc-d262-4232-88fa-f27526ec1fe6] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:32:26.633899 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:32:26.634552 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:32:26.651859 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 90bc9ddc-d262-4232-88fa-f27526ec1fe6] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:32:26.654364 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:32:26.655104 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:32:26.724144 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:32:26.725848 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0f8832b4-1a38-4669-b44b-d90aa4a60c76 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:32:39.105266 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:33:02.537100 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a7ea8c04-d8fc-4ff5-a4d0-0fac40c83b9d tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:33:02.563096 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a7ea8c04-d8fc-4ff5-a4d0-0fac40c83b9d tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: c937ba48-0994-4a56-b14a-c693649f7f97] While scheduling instance, the build request was already deleted. {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1572}}
May 06 12:33:03.346213 n-d-840842-1 nova-conductor[94343]: WARNING nova.scheduler.client.report [None req-a7ea8c04-d8fc-4ff5-a4d0-0fac40c83b9d tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Unable to delete allocation for instance c937ba48-0994-4a56-b14a-c693649f7f97: (409 {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Inventory and/or allocations changed while attempting to allocate: Another thread concurrently updated the data. Please retry your update  ", "code": "placement.concurrent_update", "request_id": "req-3a753b3d-07a9-4a84-b050-f0c88bc3f42d"}]}): nova.exception.BuildRequestNotFound: BuildRequest not found for instance c937ba48-0994-4a56-b14a-c693649f7f97
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server [None req-a7ea8c04-d8fc-4ff5-a4d0-0fac40c83b9d tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Exception during message handling: nova.exception.AllocationDeleteFailed: Failed to delete allocations for consumer c937ba48-0994-4a56-b14a-c693649f7f97. Error: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Inventory and/or allocations changed while attempting to allocate: Another thread concurrently updated the data. Please retry your update  ", "code": "placement.concurrent_update", "request_id": "req-3a753b3d-07a9-4a84-b050-f0c88bc3f42d"}]}
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/manager.py", line 1568, in schedule_and_build_instances
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     objects.BuildRequest.get_by_instance_uuid(
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     result = fn(cls, context, *args, **kwargs)
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/build_request.py", line 176, in get_by_instance_uuid
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid)
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1014, in wrapper
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     return fn(*args, **kwargs)
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/build_request.py", line 171, in _get_by_instance_uuid_from_db
May 06 12:33:03.434920 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     raise exception.BuildRequestNotFound(uuid=instance_uuid)
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server nova.exception.BuildRequestNotFound: BuildRequest not found for instance c937ba48-0994-4a56-b14a-c693649f7f97
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server 
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server 
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/manager.py", line 1585, in schedule_and_build_instances
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     self.report_client.delete_allocation_for_instance(
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/scheduler/client/report.py", line 73, in wrapper
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     return f(self, *a, **k)
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/scheduler/client/report.py", line 2117, in delete_allocation_for_instance
May 06 12:33:03.437214 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server     raise exception.AllocationDeleteFailed(consumer_uuid=uuid,
May 06 12:33:03.443204 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server nova.exception.AllocationDeleteFailed: Failed to delete allocations for consumer c937ba48-0994-4a56-b14a-c693649f7f97. Error: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Inventory and/or allocations changed while attempting to allocate: Another thread concurrently updated the data. Please retry your update  ", "code": "placement.concurrent_update", "request_id": "req-3a753b3d-07a9-4a84-b050-f0c88bc3f42d"}]}
May 06 12:33:03.443204 n-d-840842-1 nova-conductor[94343]: ERROR oslo_messaging.rpc.server 
May 06 12:33:06.651196 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:33:07.073626 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:33:07.177423 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:33:07.178084 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:33:07.311393 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:33:07.312794 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:33:07.315956 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:33:07.318103 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:33:07.364707 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:33:07.380190 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for user fecb0beba56547439cb6c69675b1bab5 and project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:33:07.422292 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 4ad7fa35-e435-471f-981e-dc4849e431e2] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:33:07.427988 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:33:07.427988 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:33:07.443437 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 4ad7fa35-e435-471f-981e-dc4849e431e2] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:33:07.444748 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:33:07.445167 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:33:07.491602 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:33:07.492647 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4aee7790-5d5b-4a36-91d6-7849111b8a61 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:33:07.662799 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 46452.
May 06 12:34:06.014147 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:34:06.080056 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:06.081035 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:06.241860 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:06.243215 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:06.244727 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:06.246597 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:06.368771 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:34:06.380853 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for user fecb0beba56547439cb6c69675b1bab5 and project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:34:06.426310 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: a5848b71-f969-48a5-8a0e-296b8a49ad9b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:34:06.427949 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:06.428484 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:06.460273 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: a5848b71-f969-48a5-8a0e-296b8a49ad9b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:34:06.463123 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:06.469806 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:06.559990 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:06.562031 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-bd231278-fc72-4da9-a2e5-52da7ef7c742 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:49.957731 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Took 1.26 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:34:50.063004 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:50.063417 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:50.159747 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:50.160151 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:50.160875 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:50.167491 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:50.235903 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:34:50.247730 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for user fecb0beba56547439cb6c69675b1bab5 and project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:34:50.282508 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 9e5c2341-312e-41fd-97df-2940a726eeb9] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:34:50.283396 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:50.283797 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:50.296269 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 9e5c2341-312e-41fd-97df-2940a726eeb9] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:34:50.297897 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:50.298476 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:50.347214 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:34:50.347623 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d5476235-e8c0-408e-b6fb-ea6baed56a2e tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:34:55.094693 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:34:56.107216 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 48510.
May 06 12:35:03.080961 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Took 1.11 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:35:03.170809 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:03.172433 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:03.384763 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:03.384953 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:03.386304 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:03.393924 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:03.482175 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Getting quotas for project 732f7677e2c449f8a18a4693bfe1878b. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:35:03.492611 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Getting quotas for user b8b487619bba474a8da7037542369b26 and project 732f7677e2c449f8a18a4693bfe1878b. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:35:03.539437 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] [instance: a8850424-21c4-49e1-b860-5fb976992fe6] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:35:03.541296 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:03.546897 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:03.557858 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] [instance: a8850424-21c4-49e1-b860-5fb976992fe6] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:35:03.561851 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:03.562877 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:03.625776 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:03.628004 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f0ae61ea-0f01-4f43-91ae-8b1e49b94338 tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:05.289560 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:35:25.213883 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:35:25.315972 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:25.316717 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:25.510665 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:25.510665 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:25.525423 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:25.525423 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:25.596647 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:35:25.606673 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for user fecb0beba56547439cb6c69675b1bab5 and project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:35:25.643376 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: ac38bede-8652-4224-8663-48ab21bae972] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:35:25.644365 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:25.644924 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:25.662452 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: ac38bede-8652-4224-8663-48ab21bae972] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:35:25.670823 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:25.671241 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:25.738613 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:25.739020 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f14fc440-72c8-43b6-8fb5-01857701d9bf tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:42.648750 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Took 1.14 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:35:42.712591 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:42.714338 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:42.975352 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:42.975352 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:42.975352 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:42.975352 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:43.045584 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Getting quotas for project dc06fa4b1fcc4d2ba2a1dcf85b3b0ed0. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:35:43.045584 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Getting quotas for user be7b984d40794369ba9b0662c57a2269 and project dc06fa4b1fcc4d2ba2a1dcf85b3b0ed0. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:35:43.099193 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] [instance: 9e2523ef-f783-4efb-932c-1ae969111148] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:35:43.101540 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:43.102398 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:43.124663 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] [instance: 9e2523ef-f783-4efb-932c-1ae969111148] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:35:43.127482 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:43.129230 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:43.237408 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:35:43.239158 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-57f11f85-0843-4830-819e-42072d355878 tempest-TestServerAdvancedOps-13822200 tempest-TestServerAdvancedOps-13822200-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:35:59.117094 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:36:07.662541 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:36:08.677618 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 50206.
May 06 12:36:29.069894 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:36:29.148639 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:36:29.149144 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:36:29.235836 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:36:29.240635 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:36:29.240635 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:36:29.241100 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:36:29.322001 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:36:29.331732 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for user fecb0beba56547439cb6c69675b1bab5 and project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:36:29.382980 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 980ce928-ec62-44e0-8250-50e78b9441b0] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:36:29.386130 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:36:29.386727 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:36:29.405263 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 980ce928-ec62-44e0-8250-50e78b9441b0] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:36:29.406131 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:36:29.406759 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:36:29.493561 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:36:29.495722 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-080a4ed7-0ec6-400b-8c45-9f18d9e4cd78 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:06.419810 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:37:06.503290 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:06.506933 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:06.720072 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:06.720714 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:06.798001 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:06.798571 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:06.874782 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:37:06.897730 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Getting quotas for user fecb0beba56547439cb6c69675b1bab5 and project db43247e2b7b4d5ab91942bc59ac50da. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:37:06.967610 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 7136d2f4-34f6-41ba-8804-8f8f49877171] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:37:06.968935 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:06.970561 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:06.990185 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] [instance: 7136d2f4-34f6-41ba-8804-8f8f49877171] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:37:06.991657 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:06.995063 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:07.088726 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:07.090019 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3b4bdddf-3e41-4972-8d55-8b96166c86b3 tempest-ServersTestJSON-469948452 tempest-ServersTestJSON-469948452-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:25.352429 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:37:25.481938 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:25.482624 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:25.625182 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:25.629657 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:25.632091 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:25.632539 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:25.714712 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Getting quotas for project 732f7677e2c449f8a18a4693bfe1878b. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:37:25.734260 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Getting quotas for user b8b487619bba474a8da7037542369b26 and project 732f7677e2c449f8a18a4693bfe1878b. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:37:25.814423 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] [instance: 72d5bb0f-3339-4109-90d7-f986fd2837b5] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:37:25.822774 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:25.824143 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:25.862407 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] [instance: 72d5bb0f-3339-4109-90d7-f986fd2837b5] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:37:25.864845 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:25.870920 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:25.962697 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:37:25.963440 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-d652eeee-2231-44a8-91fe-7cef94753f2d tempest-VolumesSnapshotTestJSON-1756009547 tempest-VolumesSnapshotTestJSON-1756009547-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:37:56.124136 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:37:57.117730 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 52790.
May 06 12:38:25.311758 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:38:59.502294 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:38:59.598089 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:38:59.598702 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:38:59.915197 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:38:59.916150 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:38:59.917721 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:38:59.919216 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:38:59.967320 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Getting quotas for project 2d4439810d7c4e3b81379eab06ca7cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:38:59.996586 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Getting quotas for user 1c14092b268f44dda542b0d34b166f21 and project 2d4439810d7c4e3b81379eab06ca7cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:39:00.043615 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] [instance: c8fd6fac-0d3e-4d38-bcc8-78e16ef2ebd5] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:39:00.047974 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:39:00.049375 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:39:00.070455 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] [instance: c8fd6fac-0d3e-4d38-bcc8-78e16ef2ebd5] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:39:00.078877 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:39:00.082066 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:39:00.209756 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:39:00.210835 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76e0213a-c17a-4f7a-b089-51418eccbdc8 tempest-VolumesNegativeTest-1372168089 tempest-VolumesNegativeTest-1372168089-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:39:08.674247 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:39:09.686582 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 54426.
May 06 12:39:18.689225 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:39:18.798619 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:39:18.802278 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:39:18.992235 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:39:18.992893 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:39:18.996399 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:39:18.998035 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:39:19.021900 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Getting quotas for project da42db6b607d4b6e8aa03556e52415dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:39:19.027846 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Getting quotas for user 4046db70882c4c909da388fd49b09bf8 and project da42db6b607d4b6e8aa03556e52415dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:39:19.048747 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] [instance: dd415a13-b57d-43a9-898d-8a0aa9fe6b7f] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:39:19.049818 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:39:19.050963 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:39:19.106437 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] [instance: dd415a13-b57d-43a9-898d-8a0aa9fe6b7f] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:39:19.106744 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:39:19.107209 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:39:19.132513 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:39:19.180335 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:39:19.181686 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-bb9696a2-2cef-44c0-9c85-f4cf815f08e7 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:40:36.564863 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:40:36.649173 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:40:36.649826 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:40:36.810528 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:40:36.811664 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:40:36.813245 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:40:36.814235 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:40:36.866251 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Getting quotas for project 688fe93ff03a4146b5ca4488527f3bb6. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:40:36.872640 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Getting quotas for user beb216fd7ab44f22b38e2b1d421eb33f and project 688fe93ff03a4146b5ca4488527f3bb6. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:40:36.889278 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] [instance: 78057624-5a4b-45fb-9246-73838ab5ec1b] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:40:36.891150 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:40:36.891912 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:40:36.903296 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] [instance: 78057624-5a4b-45fb-9246-73838ab5ec1b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:40:36.904995 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:40:36.905742 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:40:36.956258 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:40:36.957257 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-0d8d60c6-0647-472e-8d23-f225d2023820 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:40:57.132878 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:40:58.139438 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 56040.
May 06 12:41:29.904028 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:41:29.977925 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:41:29.978501 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:41:30.134655 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:41:30.134655 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:41:30.149719 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:41:30.149719 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:41:30.253508 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Getting quotas for project 67d115b646dd49b3898ae06f9e4e84bf. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:41:30.253508 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Getting quotas for user 5b7dca49f8ce4ec08a8fe1986fddddc2 and project 67d115b646dd49b3898ae06f9e4e84bf. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:41:30.294738 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] [instance: feaac5b2-09cb-4913-bd07-4ca9319f9d94] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:41:30.294738 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:41:30.294738 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:41:30.306841 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] [instance: feaac5b2-09cb-4913-bd07-4ca9319f9d94] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:41:30.306841 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:41:30.306841 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:41:30.396934 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:41:30.396934 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9cf8c6df-6d4c-45e9-8d2d-2f2c690408c1 tempest-TestServerBasicOps-1689068819 tempest-TestServerBasicOps-1689068819-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:41:45.314374 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:42:02.520728 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-9a934f38-d9d0-473b-b066-fa06a90f7f2d tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method unshelve_instance {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:42:02.538197 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9a934f38-d9d0-473b-b066-fa06a90f7f2d tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:42:02.538197 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9a934f38-d9d0-473b-b066-fa06a90f7f2d tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:42:03.664381 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-9a934f38-d9d0-473b-b066-fa06a90f7f2d tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] [instance: dd415a13-b57d-43a9-898d-8a0aa9fe6b7f] Requesting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) during scheduling {{(pid=94343) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}}
May 06 12:42:04.602249 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-9a934f38-d9d0-473b-b066-fa06a90f7f2d tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:42:04.611825 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance [None req-9a934f38-d9d0-473b-b066-fa06a90f7f2d tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lazy-loading 'flavor' on Instance uuid dd415a13-b57d-43a9-898d-8a0aa9fe6b7f {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 12:42:09.692376 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:42:10.706185 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 57118.
May 06 12:42:29.799812 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:42:29.853678 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:42:29.853678 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:42:29.951049 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:42:29.951049 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:42:29.952168 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:42:29.952889 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:42:29.984897 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Getting quotas for project 8c9dded879774dab8f9384e934c1f3e0. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:42:29.994549 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Getting quotas for user df88dcc1e7a94beab6a00a3e2f0ab6ef and project 8c9dded879774dab8f9384e934c1f3e0. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:42:30.012020 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] [instance: 849a43b0-1f04-41a6-82d3-63f525e23757] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:42:30.013742 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:42:30.014388 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:42:30.028091 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] [instance: 849a43b0-1f04-41a6-82d3-63f525e23757] block_device_mapping [BlockDeviceMapping(attachment_id=e368e993-1ac6-46c8-9550-a0606636918c,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='9e857eb0-c3b7-4f74-81f8-0ca92f16ea34',volume_size=1,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:42:30.030456 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:42:30.031133 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:42:30.097442 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:42:30.098230 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-74ec6db3-d929-4d67-acd4-9a5fdbe2e77b tempest-TestVolumeBackupRestore-1212043311 tempest-TestVolumeBackupRestore-1212043311-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:42:30.365855 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3de6c69b-e2c5-4376-a8f1-2b115350fef0 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:42:30.366772 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3de6c69b-e2c5-4376-a8f1-2b115350fef0 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:42:30.367524 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3de6c69b-e2c5-4376-a8f1-2b115350fef0 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:42:30.612132 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-3de6c69b-e2c5-4376-a8f1-2b115350fef0 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] [instance: 78057624-5a4b-45fb-9246-73838ab5ec1b] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94343) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 12:42:31.041016 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-3de6c69b-e2c5-4376-a8f1-2b115350fef0 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Created allocations for migration 1f85be58-fe14-4b83-8e1c-6a833149e2ac on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 12:42:31.492567 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-3de6c69b-e2c5-4376-a8f1-2b115350fef0 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] [instance: 78057624-5a4b-45fb-9246-73838ab5ec1b] Calling prep_resize with selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94343) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 12:42:39.147240 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:43:44.889032 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:43:44.938415 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:43:44.938415 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:43:45.052619 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:43:45.053467 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:43:45.054995 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:43:45.055678 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:43:45.097739 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Getting quotas for project 688fe93ff03a4146b5ca4488527f3bb6. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:43:45.110976 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Getting quotas for user beb216fd7ab44f22b38e2b1d421eb33f and project 688fe93ff03a4146b5ca4488527f3bb6. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:43:45.144507 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] [instance: 972ca49b-70d4-4629-9391-2f95199db42c] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:43:45.145539 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:43:45.146032 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:43:45.161921 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] [instance: 972ca49b-70d4-4629-9391-2f95199db42c] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:43:45.163835 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:43:45.164271 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:43:45.223793 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:43:45.224788 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ac6e9f6c-a0a9-4e42-882e-9fad4cab664d tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:43:58.138290 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:43:59.155666 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 59202.
May 06 12:44:14.660977 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:44:14.714228 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:14.716773 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:14.859654 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:14.860438 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:14.862754 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:14.863173 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:14.890166 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Getting quotas for project 29d60a4d2e074444bdd9c36b88debd82. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:44:14.899413 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Getting quotas for user a3212b6773934f8295a3cd362d1cb42f and project 29d60a4d2e074444bdd9c36b88debd82. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:44:14.915324 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] [instance: c539903b-57ac-4129-a9e6-b47e1088ed4f] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:44:14.916326 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:14.916801 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:14.928148 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] [instance: c539903b-57ac-4129-a9e6-b47e1088ed4f] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:44:14.930412 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:14.931400 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:14.982457 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:14.983772 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-76999874-822e-46a3-9ea3-9ba4ed0e56ae tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:18.181758 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:44:18.256562 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:18.257021 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:18.335574 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:18.336387 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:18.337502 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:18.338032 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:18.366215 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Getting quotas for project da42db6b607d4b6e8aa03556e52415dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:44:18.373802 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Getting quotas for user 4046db70882c4c909da388fd49b09bf8 and project da42db6b607d4b6e8aa03556e52415dd. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:44:18.416861 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] [instance: 3f1e0fd0-3d46-4100-a0e2-a331a3ccbaad] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:44:18.423206 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:18.423726 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:18.435763 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] [instance: 3f1e0fd0-3d46-4100-a0e2-a331a3ccbaad] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:44:18.438496 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:18.439156 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:44:18.522598 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:44:18.523387 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-2d428764-25aa-478c-9fc3-7b9b2bae45ee tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:45:05.324845 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:45:10.698190 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:45:11.708738 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 59546.
May 06 12:45:27.205387 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-12c14a89-33c3-4a38-8337-17059f2e9515 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:45:27.206273 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-12c14a89-33c3-4a38-8337-17059f2e9515 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:45:27.206273 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-12c14a89-33c3-4a38-8337-17059f2e9515 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:45:27.337754 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-12c14a89-33c3-4a38-8337-17059f2e9515 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] [instance: 972ca49b-70d4-4629-9391-2f95199db42c] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94343) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 12:45:27.772840 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-12c14a89-33c3-4a38-8337-17059f2e9515 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Created allocations for migration de167fd0-ff90-4933-896a-8afe91b0403a on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 12:45:27.996028 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-12c14a89-33c3-4a38-8337-17059f2e9515 tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] [instance: 972ca49b-70d4-4629-9391-2f95199db42c] Calling prep_resize with selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94343) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 12:45:59.160540 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:46:04.166116 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:46:04.194206 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:04.194598 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:04.261425 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:04.262023 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:04.263094 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:04.263484 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:04.285501 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Getting quotas for project 29d60a4d2e074444bdd9c36b88debd82. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:46:04.297865 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Getting quotas for user a3212b6773934f8295a3cd362d1cb42f and project 29d60a4d2e074444bdd9c36b88debd82. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:46:04.323241 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] [instance: 94d5b71c-a1cf-4b7e-808f-e14868493048] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:46:04.325513 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:04.325796 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:04.336282 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] [instance: 94d5b71c-a1cf-4b7e-808f-e14868493048] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:46:04.337970 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:04.338493 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:04.374573 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:04.374980 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-de79f22c-a93e-4457-b346-8f895b334f94 tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:14.838183 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:46:14.898004 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:14.898671 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:14.989582 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:14.990294 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:14.991162 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:14.991729 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:15.011746 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Getting quotas for project 688fe93ff03a4146b5ca4488527f3bb6. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:46:15.017496 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Getting quotas for user beb216fd7ab44f22b38e2b1d421eb33f and project 688fe93ff03a4146b5ca4488527f3bb6. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:46:15.030799 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] [instance: b465e33e-f122-49a3-8a1e-48c182076776] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:46:15.032016 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:15.032571 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:15.040631 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] [instance: b465e33e-f122-49a3-8a1e-48c182076776] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:46:15.044115 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:15.044801 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:15.100998 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:15.101463 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a4e86c00-3f83-47d1-b262-a0cfcb569e89 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:34.911293 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-edad4071-20a5-4c6f-841e-78b3552b6410 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method unshelve_instance {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:46:34.911863 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edad4071-20a5-4c6f-841e-78b3552b6410 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:46:34.912099 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-edad4071-20a5-4c6f-841e-78b3552b6410 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:46:35.317424 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-edad4071-20a5-4c6f-841e-78b3552b6410 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] [instance: 3f1e0fd0-3d46-4100-a0e2-a331a3ccbaad] Requesting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) during scheduling {{(pid=94344) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}}
May 06 12:46:35.540921 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-edad4071-20a5-4c6f-841e-78b3552b6410 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:46:35.548806 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-edad4071-20a5-4c6f-841e-78b3552b6410 tempest-AttachVolumeShelveTestJSON-1630322564 tempest-AttachVolumeShelveTestJSON-1630322564-project] Lazy-loading 'flavor' on Instance uuid 3f1e0fd0-3d46-4100-a0e2-a331a3ccbaad {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 12:46:59.154707 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:47:00.163977 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 60276.
May 06 12:47:44.033226 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:47:44.066314 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:47:44.066314 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:47:44.132785 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:47:44.133372 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:47:44.134672 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:47:44.135313 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:47:44.158996 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Getting quotas for project 29d60a4d2e074444bdd9c36b88debd82. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:47:44.164767 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Getting quotas for user a3212b6773934f8295a3cd362d1cb42f and project 29d60a4d2e074444bdd9c36b88debd82. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:47:44.177397 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] [instance: f6247cac-982b-47eb-b196-9cac60938885] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:47:44.179158 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:47:44.179836 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:47:44.188046 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] [instance: f6247cac-982b-47eb-b196-9cac60938885] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:47:44.190044 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:47:44.190441 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:47:44.221385 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:47:44.221892 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-a74a39c9-831c-464a-941a-f8781683b43b tempest-TestNetworkBasicOps-845878924 tempest-TestNetworkBasicOps-845878924-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:47:56.455521 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:47:56.456186 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:47:56.456377 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:47:56.813997 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Created allocations for migration 9e43508f-e8ce-4e64-a374-bf5a003800f2 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 12:47:56.905301 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.live_migrate [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] [instance: b465e33e-f122-49a3-8a1e-48c182076776] Requesting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while live migrating {{(pid=94344) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}}
May 06 12:47:57.164697 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Lazy-loading 'resources' on Instance uuid b465e33e-f122-49a3-8a1e-48c182076776 {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 12:47:57.169701 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Lazy-loading 'pci_requests' on Instance uuid b465e33e-f122-49a3-8a1e-48c182076776 {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 12:47:57.451161 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.live_migrate [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] [instance: b465e33e-f122-49a3-8a1e-48c182076776] Start binding ports on destination host: n-h2-840842-1 {{(pid=94344) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}}
May 06 12:47:57.959876 n-d-840842-1 nova-conductor[94344]: ERROR nova.network.neutron [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] [instance: b465e33e-f122-49a3-8a1e-48c182076776] Binding failed for port bda6a8c2-d2f8-4ea2-bf99-40acbcf6a5c3 and host n-h2-840842-1. Error: (500 {"NeutronError": {"type": "PortBindingError", "message": "Binding for port bda6a8c2-d2f8-4ea2-bf99-40acbcf6a5c3 on host n-h2-840842-1 could not be created or updated.", "detail": ""}})
May 06 12:47:57.959876 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.live_migrate [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Skipping host: n-h2-840842-1 because: Migration pre-check error: Binding failed for port bda6a8c2-d2f8-4ea2-bf99-40acbcf6a5c3, please check neutron logs for more information. {{(pid=94344) _find_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:554}}
May 06 12:47:58.547482 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Created allocations for instance b465e33e-f122-49a3-8a1e-48c182076776 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}}
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] Failed to compute_task_migrate_server: No valid host was found. There are not enough hosts available.
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]: Traceback (most recent call last):
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:     return func(*args, **kwargs)
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:   File "/opt/stack/nova/nova/scheduler/manager.py", line 203, in select_destinations
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:     selections = self.driver.select_destinations(ctxt, spec_obj,
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:   File "/opt/stack/nova/nova/scheduler/filter_scheduler.py", line 93, in select_destinations
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:     host_selections = self._schedule(context, spec_obj, instance_uuids,
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:   File "/opt/stack/nova/nova/scheduler/filter_scheduler.py", line 263, in _schedule
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:     self._ensure_sufficient_hosts(context, claimed_hosts, num_instances,
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:   File "/opt/stack/nova/nova/scheduler/filter_scheduler.py", line 301, in _ensure_sufficient_hosts
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]:     raise exception.NoValidHost(reason=reason)
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]: nova.exception.NoValidHost: No valid host was found. There are not enough hosts available.
May 06 12:47:58.547991 n-d-840842-1 nova-conductor[94344]: : nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available.
May 06 12:47:58.549002 n-d-840842-1 nova-conductor[94344]: WARNING nova.scheduler.utils [None req-7a810113-9836-45d5-8bb6-4204152078ce tempest-TestNetworkAdvancedServerOps-1207078022 tempest-TestNetworkAdvancedServerOps-1207078022-project-admin] [instance: b465e33e-f122-49a3-8a1e-48c182076776] Setting instance to ACTIVE state.: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available.
May 06 12:48:25.334329 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:48:25.776070 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:48:25.824275 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:48:25.824731 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:48:25.895242 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:48:25.895732 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:48:25.896862 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:48:25.897466 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:48:25.919080 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Getting quotas for project 688fe93ff03a4146b5ca4488527f3bb6. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:48:25.924320 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Getting quotas for user beb216fd7ab44f22b38e2b1d421eb33f and project 688fe93ff03a4146b5ca4488527f3bb6. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:48:25.937553 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] [instance: 3388c567-c6b3-4188-8ada-525e3a407bc4] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:48:25.938634 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:48:25.939046 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:48:25.948125 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] [instance: 3388c567-c6b3-4188-8ada-525e3a407bc4] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:48:25.949605 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:48:25.950072 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:48:25.993183 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:48:25.994043 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3330f342-a5af-42e0-84ed-e3b94ab27c37 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:49:45.214200 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:49:45.243611 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:49:45.244016 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:49:45.308822 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:49:45.309264 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:49:45.310049 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:49:45.310476 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:49:45.329698 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Getting quotas for project d5fe5d4935334b08b58a4d2027ab6b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:49:45.334873 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Getting quotas for user 314636189b32447fba03b2464d7f9572 and project d5fe5d4935334b08b58a4d2027ab6b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:49:45.346748 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] [instance: 9484a698-37ce-4715-8b75-2ed0d49c57dc] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:49:45.347893 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:49:45.348282 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:49:45.356050 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] [instance: 9484a698-37ce-4715-8b75-2ed0d49c57dc] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:49:45.357597 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:49:45.358093 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:49:45.392605 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:49:45.393290 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-ea6f06ca-2a6a-4fc2-95e1-b7df1037cf07 tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:49:50.154532 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-71f3d40d-66d4-45f5-ae4e-5b96605e6f55 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method rebuild_instance {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 12:49:50.155048 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-71f3d40d-66d4-45f5-ae4e-5b96605e6f55 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:49:50.155433 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-71f3d40d-66d4-45f5-ae4e-5b96605e6f55 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:49:50.174567 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-71f3d40d-66d4-45f5-ae4e-5b96605e6f55 tempest-TestNetworkAdvancedServerOps-1032353065 tempest-TestNetworkAdvancedServerOps-1032353065-project] [instance: 3388c567-c6b3-4188-8ada-525e3a407bc4] No migration record for the rebuild/evacuate request. {{(pid=94343) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}}
May 06 12:50:00.165023 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:50:01.175100 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 34644.
May 06 12:50:11.712909 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:50:12.721452 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 34814.
May 06 12:50:53.413775 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:50:54.422047 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 35152.
May 06 12:50:59.176502 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:51:31.097483 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:51:31.135595 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:51:31.136144 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:51:31.214464 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:51:31.215186 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:51:31.216102 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:51:31.216682 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:51:31.254223 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Getting quotas for project d5fe5d4935334b08b58a4d2027ab6b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:51:31.263525 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Getting quotas for user 314636189b32447fba03b2464d7f9572 and project d5fe5d4935334b08b58a4d2027ab6b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:51:31.292944 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] [instance: 48dc83be-93f1-45fe-b6a4-07d7284700c2] Selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:51:31.294291 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:51:31.294887 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:51:31.305867 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] [instance: 48dc83be-93f1-45fe-b6a4-07d7284700c2] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:51:31.308629 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:51:31.309394 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:51:31.351614 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:51:31.352295 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-54ef1226-4372-44f4-b760-0219b65b12fe tempest-TestSecurityGroupsBasicOps-134696543 tempest-TestSecurityGroupsBasicOps-134696543-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:51:32.446456 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:52:19.050720 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:52:19.075258 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:19.075804 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:19.139468 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:19.139876 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:19.140609 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:19.141003 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:19.163537 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Getting quotas for project 220e7cdb70454fe7946d189eea567290. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:52:19.169793 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Getting quotas for user 1046baef436d434aad8b8d094b9bcb02 and project 220e7cdb70454fe7946d189eea567290. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:52:19.183034 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] [instance: 5e7287ce-fc5f-494c-bb9e-0584dfe10297] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:52:19.183823 n-d-840842-1 nova-conductor[94343]: DEBUG nova.scheduler.utils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-840842-1']) and/or node ([]) {{(pid=94343) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}}
May 06 12:52:19.184573 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:19.185052 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:19.195576 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] [instance: 5e7287ce-fc5f-494c-bb9e-0584dfe10297] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:52:19.197101 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:19.197745 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:19.228544 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:19.229110 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-6bc88f4e-cb13-4124-8c48-49b5b7aeac24 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:33.073086 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:52:33.111850 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:33.112519 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:33.180950 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:33.181370 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:33.182087 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:33.182502 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:33.198963 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Getting quotas for project 220e7cdb70454fe7946d189eea567290. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:52:33.204119 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Getting quotas for user 1046baef436d434aad8b8d094b9bcb02 and project 220e7cdb70454fe7946d189eea567290. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:52:33.215892 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] [instance: 2b58a723-042f-48cd-9013-e33cbd218c10] Selected host: n-h2-840842-1; Selected node: n-h2-840842-1; Alternates: [] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:52:33.216431 n-d-840842-1 nova-conductor[94344]: DEBUG nova.scheduler.utils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-840842-1']) and/or node ([]) {{(pid=94344) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}}
May 06 12:52:33.217241 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:33.217636 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:33.226006 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] [instance: 2b58a723-042f-48cd-9013-e33cbd218c10] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:52:33.227696 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:33.228359 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:52:33.262832 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:52:33.263248 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-a9324e3c-9901-4b06-8937-99656ddc8572 tempest-TestServerMultinode-1101202308 tempest-TestServerMultinode-1101202308-project-admin] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:53:01.177344 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:53:02.186495 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 36216.
May 06 12:53:12.722848 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:53:13.736601 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 36254.
May 06 12:53:17.717785 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:53:17.743281 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:53:17.743680 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:53:17.793083 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:53:17.793519 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:53:17.794231 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:53:17.794617 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:53:17.811061 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:53:17.816721 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for user c75c2984798946e4bdbf5b823727975a and project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:53:17.828137 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: bdc54991-05ec-45c8-8462-581e2b07a058] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:53:17.829135 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:53:17.829538 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:53:17.837597 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: bdc54991-05ec-45c8-8462-581e2b07a058] block_device_mapping [BlockDeviceMapping(attachment_id=b9cf2b39-6845-4793-8c6f-dfe541771b7e,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='9b791641-8f2c-4d29-9f8a-6f1c5526f985',volume_size=1,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:53:17.839030 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:53:17.839451 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:53:17.869140 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:53:17.869562 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-655dc23f-f8bb-4c54-8b6f-7a7893908b79 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:02.358816 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:54:02.383084 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:02.383483 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:02.442119 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:02.442544 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:02.443255 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:02.443640 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:02.459584 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:54:02.464238 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for user c75c2984798946e4bdbf5b823727975a and project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:54:02.475617 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 4f9819eb-141c-4594-9c43-30e89c46e877] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:54:02.476459 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:02.476877 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:02.487272 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 4f9819eb-141c-4594-9c43-30e89c46e877] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id='862ec927-04bb-40bb-8ea4-bc64b0ec82b8',source_type='snapshot',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=1,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:54:02.488452 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:02.488906 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:02.519442 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:02.519850 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-9a33f964-c53c-49ff-9f80-decf236a3679 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:19.186064 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:54:56.963100 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:54:56.987929 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:56.988340 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:57.036596 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:57.036878 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:57.037649 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:57.038040 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:57.053963 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:54:57.058577 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for user c75c2984798946e4bdbf5b823727975a and project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:54:57.069913 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 2f45b9c8-2755-4990-8ea0-f6d30d3b511d] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:54:57.070871 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:57.071254 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:57.079742 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 2f45b9c8-2755-4990-8ea0-f6d30d3b511d] block_device_mapping [BlockDeviceMapping(attachment_id=aec69ffd-95a4-4c71-8147-4f2aa9b51b37,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='2604b845-a070-403a-99f7-a439c5392eb6',volume_size=1,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:54:57.081021 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:57.081447 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:54:57.113500 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:54:57.113911 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-80cc0668-91cf-41db-a983-269017626971 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:55:05.350601 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:55:20.023307 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:55:20.047433 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:55:20.047844 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:55:20.118146 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:55:20.118547 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:55:20.119507 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:55:20.119652 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:55:20.136735 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:55:20.142445 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for user c75c2984798946e4bdbf5b823727975a and project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:55:20.153993 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 6bdd8f4d-263c-46ea-981f-eb802ba1ce11] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:55:20.155669 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:55:20.156076 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:55:20.163683 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 6bdd8f4d-263c-46ea-981f-eb802ba1ce11] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id='3b7db913-096d-4cc0-9b4f-c0a5c26c19ea',source_type='snapshot',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=1,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:55:20.164900 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:55:20.165340 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:55:20.202630 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:55:20.203039 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-92148dc3-5e20-466a-8503-9cf2303077d0 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:56:02.186801 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:56:03.196877 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37012.
May 06 12:56:13.738703 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:56:14.747437 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37172.
May 06 12:56:23.162398 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:56:23.188302 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:56:23.188712 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:56:23.237920 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:56:23.238319 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:56:23.239086 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:56:23.239452 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:56:23.255911 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:56:23.260656 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for user c75c2984798946e4bdbf5b823727975a and project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:56:23.271966 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 4759a755-171c-4816-9584-5b5fe66da7a7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:56:23.272904 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:56:23.273339 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:56:23.280869 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 4759a755-171c-4816-9584-5b5fe66da7a7] block_device_mapping [BlockDeviceMapping(attachment_id=0a0e3a62-d57b-4ed0-8b39-de978f40cb75,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='15d17d18-7141-44c4-a933-0bc19916f128',volume_size=1,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:56:23.282147 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:56:23.282589 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:56:23.312871 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:56:23.313404 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fc2c2a3f-bac2-4815-a120-fdf09eb2bfc6 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:57:30.294149 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:57:31.308801 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37304.
May 06 12:57:39.197129 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:57:50.928289 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:57:51.938167 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37308.
May 06 12:58:09.975872 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:58:11.184459 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:58:25.362144 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 12:58:30.321652 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:58:31.335788 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37330.
May 06 12:58:49.526319 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 12:58:49.548664 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:58:49.549059 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:58:49.599768 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:58:49.600161 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:58:49.600874 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:58:49.601300 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:58:49.616876 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 12:58:49.621949 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for user c75c2984798946e4bdbf5b823727975a and project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 12:58:49.632853 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 6ca158af-d62d-4def-8b56-645337d18784] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 12:58:49.633864 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:58:49.634294 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:58:49.642667 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 6ca158af-d62d-4def-8b56-645337d18784] block_device_mapping [BlockDeviceMapping(attachment_id=35bcc85d-acb3-457a-b76d-09cb0e4b59c4,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='15d17d18-7141-44c4-a933-0bc19916f128',volume_size=1,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 12:58:49.644305 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:58:49.644997 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:58:49.678205 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 12:58:49.678611 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-7260fca4-5368-44a7-9b07-a2ea0ca46824 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 12:58:54.429178 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 12:58:55.438507 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37398.
May 06 12:59:03.198058 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:59:04.206631 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37412.
May 06 12:59:14.747916 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 12:59:15.758301 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37438.
May 06 13:00:51.276147 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [79f84da1-c3bc-4307-82d2-6fcb2b1380bc] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer
May 06 13:00:51.940876 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:00:52.284283 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [79f84da1-c3bc-4307-82d2-6fcb2b1380bc] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37518.
May 06 13:00:52.952022 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37526.
May 06 13:00:54.625754 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Took 3.35 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:00:54.649955 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:00:54.650358 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:00:54.703199 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:00:54.703642 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:00:54.704341 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:00:54.704727 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:00:54.720279 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:00:54.725041 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Getting quotas for user c75c2984798946e4bdbf5b823727975a and project a73a37a3815643e7b99082ba8fafeb7a. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:00:54.735917 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 710cc99a-2e2a-43e4-b4c4-3af3017e13d3] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:00:54.736816 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:00:54.737238 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:00:54.745757 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [instance: 710cc99a-2e2a-43e4-b4c4-3af3017e13d3] block_device_mapping [BlockDeviceMapping(attachment_id=5b5ca377-5f34-4db7-8c45-8869c0f620ae,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='57941ec4-28b6-42d4-91a3-e31adf39a9a0',volume_size=1,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:00:54.746942 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:00:54.747326 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:00:54.780999 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:00:54.781451 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:00:54.791116 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [0b77dc34-50ec-479e-adf6-7df8fc8eaef7] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer
May 06 13:00:55.798854 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [None req-f2f0e068-4efe-40bc-9291-8f9071309502 tempest-TestVolumeBootPattern-824055984 tempest-TestVolumeBootPattern-824055984-project] [0b77dc34-50ec-479e-adf6-7df8fc8eaef7] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37546.
May 06 13:00:59.206089 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:01:29.992752 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:01:31.201098 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:01:31.307241 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:01:32.337018 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37612.
May 06 13:01:45.370819 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:02:04.207903 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:02:05.216811 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37630.
May 06 13:02:15.759098 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:02:16.767664 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37636.
May 06 13:02:55.441831 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:02:56.451755 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37656.
May 06 13:03:31.333706 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:03:32.350344 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 37782.
May 06 13:03:37.785797 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:03:37.809801 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:37.810209 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:37.861966 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:37.862369 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:37.863089 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:37.863479 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:37.881178 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Getting quotas for project 894524e4f23a464e8c9ddc3fc401eb9e. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:03:37.886223 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Getting quotas for user e13846d728a04ddf91da38bc9b80756c and project 894524e4f23a464e8c9ddc3fc401eb9e. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:03:37.897897 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] [instance: e0148549-43a8-4d8f-aded-c386033fb102] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:03:37.898756 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:37.899115 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:37.906507 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] [instance: e0148549-43a8-4d8f-aded-c386033fb102] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:03:37.907967 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:37.908434 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:37.937148 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:37.937809 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eff95a81-60d2-4a58-a1f0-ff48c8150cb8 tempest-ServersAdminNegativeTestJSON-448756093 tempest-ServersAdminNegativeTestJSON-448756093-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:59.231168 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:03:59.253470 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:59.253871 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:59.319728 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:59.320159 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:59.320884 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:59.321316 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:59.336492 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Getting quotas for project dc5c7c75dfbf463981518d4fcc0d5f50. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:03:59.341032 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Getting quotas for user 8f39959438c142f4aa27b3551034f62f and project dc5c7c75dfbf463981518d4fcc0d5f50. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:03:59.352593 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] [instance: ae74a141-1e52-4cec-8c8d-4a357ce2f1c1] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:03:59.353559 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:59.353937 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:59.362209 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] [instance: ae74a141-1e52-4cec-8c8d-4a357ce2f1c1] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:03:59.363500 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:59.363890 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:03:59.396601 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:03:59.397004 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-fd33e8ae-3870-46f4-80a5-be0408bc873c tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:04:11.898715 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-36e37013-fd04-449f-bdd7-b3a03a9ef698 tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:04:11.899271 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-36e37013-fd04-449f-bdd7-b3a03a9ef698 tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:04:11.899548 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-36e37013-fd04-449f-bdd7-b3a03a9ef698 tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:04:12.144468 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-36e37013-fd04-449f-bdd7-b3a03a9ef698 tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] [instance: ae74a141-1e52-4cec-8c8d-4a357ce2f1c1] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94344) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 13:04:12.545371 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-36e37013-fd04-449f-bdd7-b3a03a9ef698 tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] Created allocations for migration fee1c98c-f5e7-4b2a-9962-ad9e51b5704d on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 13:04:12.767103 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-36e37013-fd04-449f-bdd7-b3a03a9ef698 tempest-DeleteServersTestJSON-1377680211 tempest-DeleteServersTestJSON-1377680211-project] [instance: ae74a141-1e52-4cec-8c8d-4a357ce2f1c1] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94344) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 13:04:19.216177 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:04:56.657904 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:04:56.680231 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:04:56.680551 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:04:56.731532 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:04:56.731921 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:04:56.732644 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:04:56.733022 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:04:56.748163 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Getting quotas for project 152a84e7cae4492b9858e98895224e95. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:04:56.753311 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Getting quotas for user 19373262b7ef4e10ac2f36457066f5f8 and project 152a84e7cae4492b9858e98895224e95. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:04:56.764729 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] [instance: d18bd46f-f22f-4b8b-b6ba-69f4633d6afe] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:04:56.765813 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:04:56.766411 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:04:56.775469 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] [instance: d18bd46f-f22f-4b8b-b6ba-69f4633d6afe] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:04:56.776703 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:04:56.777098 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:04:56.836652 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:04:56.837242 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1eb65be3-1e32-4b86-b9a8-2853a9445b2e tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:05:05.217628 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:05:05.380452 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:05:06.225796 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38232.
May 06 13:05:10.271471 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-fd0130d0-3aa2-4248-ac87-8fb61bb381f4 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:05:10.271947 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0130d0-3aa2-4248-ac87-8fb61bb381f4 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:05:10.272381 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fd0130d0-3aa2-4248-ac87-8fb61bb381f4 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:05:10.394513 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-fd0130d0-3aa2-4248-ac87-8fb61bb381f4 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] [instance: d18bd46f-f22f-4b8b-b6ba-69f4633d6afe] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94344) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 13:05:10.740256 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-fd0130d0-3aa2-4248-ac87-8fb61bb381f4 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Created allocations for migration 1e1bbb83-7d81-4d0c-91ab-3a61c7d82c76 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 13:05:10.964327 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-fd0130d0-3aa2-4248-ac87-8fb61bb381f4 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] [instance: d18bd46f-f22f-4b8b-b6ba-69f4633d6afe] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94344) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 13:05:16.768690 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:05:17.779861 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38282.
May 06 13:05:49.267682 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:05:49.290959 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:05:49.291367 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:05:49.344007 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:05:49.344408 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:05:49.345150 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:05:49.345548 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:05:49.361007 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Getting quotas for project 152a84e7cae4492b9858e98895224e95. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:05:49.366028 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Getting quotas for user 19373262b7ef4e10ac2f36457066f5f8 and project 152a84e7cae4492b9858e98895224e95. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:05:49.377910 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] [instance: 4e33e05f-ead1-4e2b-9017-ef45405ff548] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:05:49.378822 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:05:49.379222 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:05:49.388206 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] [instance: 4e33e05f-ead1-4e2b-9017-ef45405ff548] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:05:49.389792 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:05:49.390285 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:05:49.423031 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:05:49.423355 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3ac75aa-3550-4965-95f6-4111c5bf6908 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:06:01.468832 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-c00fd433-057c-4c6d-9efc-036fb8ab3796 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:06:01.469400 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c00fd433-057c-4c6d-9efc-036fb8ab3796 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:06:01.469739 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-c00fd433-057c-4c6d-9efc-036fb8ab3796 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:06:01.585733 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-c00fd433-057c-4c6d-9efc-036fb8ab3796 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] [instance: 4e33e05f-ead1-4e2b-9017-ef45405ff548] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94344) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 13:06:01.863042 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-c00fd433-057c-4c6d-9efc-036fb8ab3796 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] Created allocations for migration 4232753b-c864-491f-a251-8a8792ff38f3 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 13:06:02.092739 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-c00fd433-057c-4c6d-9efc-036fb8ab3796 tempest-ServerDiskConfigTestJSON-1773152765 tempest-ServerDiskConfigTestJSON-1773152765-project] [instance: 4e33e05f-ead1-4e2b-9017-ef45405ff548] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94344) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 13:06:58.025831 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:06:58.051071 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:06:58.051470 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:06:58.109414 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:06:58.109762 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:06:58.110655 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:06:58.111043 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:06:58.127397 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Getting quotas for project 9ed656da564c412f88699f45d2046922. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:06:58.132141 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Getting quotas for user 62250f955de94a8b873383ce13853ade and project 9ed656da564c412f88699f45d2046922. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:06:58.143603 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: adfae3cf-4833-4c75-bf80-73f5dce3e514] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:06:58.144581 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:06:58.144976 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:06:58.153597 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: adfae3cf-4833-4c75-bf80-73f5dce3e514] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:06:58.155048 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:06:58.155559 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:06:58.185394 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:06:58.185886 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-1231afb9-fe89-421b-a4cd-7519e8c80591 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:07:14.790656 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-5fb16013-a0a5-4931-a414-83f343b10790 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:07:14.791212 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5fb16013-a0a5-4931-a414-83f343b10790 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:07:14.791478 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-5fb16013-a0a5-4931-a414-83f343b10790 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:07:14.908378 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-5fb16013-a0a5-4931-a414-83f343b10790 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: adfae3cf-4833-4c75-bf80-73f5dce3e514] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94344) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 13:07:15.189208 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-5fb16013-a0a5-4931-a414-83f343b10790 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Created allocations for migration 189a10ad-412e-4969-a7a7-44729459e8bd on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 13:07:15.416647 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-5fb16013-a0a5-4931-a414-83f343b10790 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: adfae3cf-4833-4c75-bf80-73f5dce3e514] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94344) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 13:07:39.225641 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:07:58.409174 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:07:58.435701 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:07:58.436110 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:07:58.487453 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:07:58.487850 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:07:58.488576 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:07:58.488961 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:07:58.505745 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Getting quotas for project 9ed656da564c412f88699f45d2046922. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:07:58.511778 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Getting quotas for user 62250f955de94a8b873383ce13853ade and project 9ed656da564c412f88699f45d2046922. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:07:58.524021 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: 769eecde-87c4-4456-8494-4202cdd302d7] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:07:58.524962 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:07:58.525399 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:07:58.533688 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: 769eecde-87c4-4456-8494-4202cdd302d7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:07:58.535003 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:07:58.535419 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:07:58.565966 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:07:58.566422 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-b6b92ab3-f4e7-49c4-9842-5d0097d428d9 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:08:06.227104 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:08:07.236522 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38812.
May 06 13:08:17.778981 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:08:18.787542 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38842.
May 06 13:08:25.391458 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:08:39.582037 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-eb4ea28e-ec18-420e-b847-7d33454d0d0a tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:08:39.582646 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eb4ea28e-ec18-420e-b847-7d33454d0d0a tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:08:39.583287 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-eb4ea28e-ec18-420e-b847-7d33454d0d0a tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:08:39.745731 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-eb4ea28e-ec18-420e-b847-7d33454d0d0a tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: 769eecde-87c4-4456-8494-4202cdd302d7] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94344) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 13:08:40.114361 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-eb4ea28e-ec18-420e-b847-7d33454d0d0a tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Created allocations for migration cf6da7ec-bddd-4fc0-be97-e03d5bb803c4 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 13:08:40.475681 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-eb4ea28e-ec18-420e-b847-7d33454d0d0a tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: 769eecde-87c4-4456-8494-4202cdd302d7] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94344) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 13:09:01.845376 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:09:01.871185 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:09:01.871498 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:09:01.917940 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:09:01.918347 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:09:01.919077 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:09:01.919475 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:09:01.936693 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Getting quotas for project 9ed656da564c412f88699f45d2046922. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:09:01.941795 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Getting quotas for user 62250f955de94a8b873383ce13853ade and project 9ed656da564c412f88699f45d2046922. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:09:01.953488 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: a198b4df-cb2c-44ea-9f60-04977ca6be45] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:09:01.954452 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:09:01.954851 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:09:01.962797 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: a198b4df-cb2c-44ea-9f60-04977ca6be45] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:09:01.964024 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:09:01.964425 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:09:01.994851 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:09:01.995493 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-f4ceaada-ebda-4d81-8a5a-70c376133939 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:09:15.739947 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-04b30193-8abb-4c02-b96f-7a24cf5c04b3 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:09:15.741001 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-04b30193-8abb-4c02-b96f-7a24cf5c04b3 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:09:15.741440 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-04b30193-8abb-4c02-b96f-7a24cf5c04b3 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:09:15.928546 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-04b30193-8abb-4c02-b96f-7a24cf5c04b3 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: a198b4df-cb2c-44ea-9f60-04977ca6be45] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94344) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 13:09:16.242196 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-04b30193-8abb-4c02-b96f-7a24cf5c04b3 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Created allocations for migration 8b69fc4e-77ae-4132-8289-c80bd827ded0 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 13:09:16.476929 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-04b30193-8abb-4c02-b96f-7a24cf5c04b3 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: a198b4df-cb2c-44ea-9f60-04977ca6be45] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94344) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 13:10:05.949186 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:10:05.973608 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:10:05.974021 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:10:06.029729 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:10:06.030144 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:10:06.030867 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:10:06.031294 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:10:06.046691 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Getting quotas for project 9ed656da564c412f88699f45d2046922. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:10:06.051662 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Getting quotas for user 62250f955de94a8b873383ce13853ade and project 9ed656da564c412f88699f45d2046922. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:10:06.062320 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: 77e952df-4168-4c54-81e6-d6b7869edf18] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:10:06.063225 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:10:06.063634 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:10:06.072011 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: 77e952df-4168-4c54-81e6-d6b7869edf18] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:10:06.073396 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:10:06.073821 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:10:06.106986 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:10:06.107383 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-61018981-996e-46e9-92be-7380b0ca95b1 tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:10:30.146616 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-0fca70fc-1f93-4630-81c9-8ce7d3cf67ca tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:10:30.147502 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0fca70fc-1f93-4630-81c9-8ce7d3cf67ca tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:10:30.147627 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-0fca70fc-1f93-4630-81c9-8ce7d3cf67ca tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:10:30.288970 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-0fca70fc-1f93-4630-81c9-8ce7d3cf67ca tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: 77e952df-4168-4c54-81e6-d6b7869edf18] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94344) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 13:10:30.579068 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-0fca70fc-1f93-4630-81c9-8ce7d3cf67ca tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] Created allocations for migration 063ce0f5-7b9e-4299-8459-47cc4bd67bb1 on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94344) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 13:10:30.868639 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.tasks.migrate [None req-0fca70fc-1f93-4630-81c9-8ce7d3cf67ca tempest-ServerActionsTestJSON-1588778937 tempest-ServerActionsTestJSON-1588778937-project] [instance: 77e952df-4168-4c54-81e6-d6b7869edf18] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94344) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 13:10:59.242107 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:11:07.237197 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:11:08.246139 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 39334.
May 06 13:11:18.788305 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:11:19.797171 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 39362.
May 06 13:11:45.400757 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:11:47.694376 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:11:47.717083 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:47.717521 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:47.771519 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:47.771884 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:47.772605 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:47.772998 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:47.789090 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Getting quotas for project 42e319e128154c8c9f885ff1f4de151f. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:11:47.793923 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Getting quotas for user cfab720a195c4129b91f8ea68c6cdd0b and project 42e319e128154c8c9f885ff1f4de151f. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:11:47.806271 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] [instance: ec8b895d-f780-4f0e-a871-8bb5c1a21f4d] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:11:47.807202 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:47.807636 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:47.815323 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] [instance: ec8b895d-f780-4f0e-a871-8bb5c1a21f4d] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:11:47.816438 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:47.816825 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:47.844663 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:47.845171 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-9ae18a98-0b26-424d-8eec-71a98e801a17 tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:59.239331 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:11:59.263730 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:59.264061 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:59.315427 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:59.315839 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:59.316564 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:59.317042 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:59.333596 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Getting quotas for project 42e319e128154c8c9f885ff1f4de151f. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:11:59.338640 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Getting quotas for user cfab720a195c4129b91f8ea68c6cdd0b and project 42e319e128154c8c9f885ff1f4de151f. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:11:59.349835 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] [instance: f0a90f11-211f-45ca-9e56-340c1ebeb8c6] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:11:59.350797 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:59.351196 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:59.359674 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] [instance: f0a90f11-211f-45ca-9e56-340c1ebeb8c6] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:11:59.361015 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:59.361447 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:11:59.399372 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:11:59.399837 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-f1fce88b-9d93-4a54-9b86-9feabb73a93e tempest-ServersNegativeTestJSON-403440524 tempest-ServersNegativeTestJSON-403440524-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:01.454765 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:13:01.479633 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:01.480044 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:01.537100 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:01.537551 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:01.538287 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:01.538684 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:01.568571 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Getting quotas for project 31dbd8a4cf8a46b2911614d8080a1865. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:13:01.574794 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Getting quotas for user d7fc8750dc954278b7ca7b91ba076256 and project 31dbd8a4cf8a46b2911614d8080a1865. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:13:01.588169 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] [instance: 6c4c1787-406a-4a84-95e6-4f296fbacf87] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:13:01.589158 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:01.589291 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:01.605105 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] [instance: 6c4c1787-406a-4a84-95e6-4f296fbacf87] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:13:01.606525 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:01.607114 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:01.640180 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:01.640868 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-88cbf06d-e10a-40b0-80ac-c57094033dac tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:36.918167 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:13:36.943312 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:36.943709 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:36.989241 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:36.989537 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:36.990245 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:36.990628 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:37.005313 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Getting quotas for project 31dbd8a4cf8a46b2911614d8080a1865. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:13:37.009702 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Getting quotas for user d7fc8750dc954278b7ca7b91ba076256 and project 31dbd8a4cf8a46b2911614d8080a1865. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:13:37.019843 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] [instance: 39d59e82-6d93-4296-99c7-700851ac862a] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:13:37.020747 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:37.021154 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:37.029849 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] [instance: 39d59e82-6d93-4296-99c7-700851ac862a] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:13:37.030990 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:37.031378 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:13:37.062699 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:13:37.063094 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b1f0cf6-0c42-4296-98dc-e747c36675df tempest-TestEncryptedCinderVolumes-352402729 tempest-TestEncryptedCinderVolumes-352402729-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:14:08.246999 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:14:09.255054 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40236.
May 06 13:14:19.250924 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:14:19.798657 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:14:20.806212 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40276.
May 06 13:14:47.452700 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:14:47.475964 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:14:47.476362 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:14:47.536161 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:14:47.536558 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:14:47.537384 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:14:47.537771 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:14:47.553351 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Getting quotas for project 57386ca640244155869c5ddf0fb528c1. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:14:47.557909 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Getting quotas for user 683f777bbe364382b20255587d7d4425 and project 57386ca640244155869c5ddf0fb528c1. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:14:47.568790 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] [instance: a96adfc3-654c-4294-96ae-93486d545de9] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:14:47.569736 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:14:47.570128 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:14:47.579660 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] [instance: a96adfc3-654c-4294-96ae-93486d545de9] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='480979a6-1320-4d3c-84fc-d9ebff4a26d3',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:14:47.580933 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:14:47.581413 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:14:47.610331 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:14:47.610806 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-379d15aa-f9cb-4dbd-a891-f09724efd20b tempest-TestMinimumBasicScenario-93969337 tempest-TestMinimumBasicScenario-93969337-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:15:05.411207 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:15:52.967095 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:15:53.977054 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40614.
May 06 13:16:30.005865 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:16:31.223600 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:16:32.327366 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:16:33.345571 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40652.
May 06 13:16:56.463840 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:16:57.473276 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40662.
May 06 13:17:09.255986 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:17:10.265458 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40664.
May 06 13:17:20.806941 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:17:21.817651 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40666.
May 06 13:17:32.355136 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:17:33.377921 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 40670.
May 06 13:17:39.271584 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:18:16.822383 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:18:16.846466 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:18:16.846865 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:18:16.900308 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:18:16.900707 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:18:16.901587 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:18:16.901859 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:18:16.919771 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:18:16.924469 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for user f2a52370b57248648518f82974a62a91 and project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:18:16.935700 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 18d0e642-73b8-4f6a-9a15-dcab7b210c42] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:18:16.936625 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:18:16.937015 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:18:16.944204 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 18d0e642-73b8-4f6a-9a15-dcab7b210c42] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:18:16.945476 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:18:16.945865 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:18:16.976679 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:18:16.977074 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-004c59fe-3bd0-4028-bd5e-e6c23d2b814b tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:18:25.420302 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:19:52.482657 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:19:53.598696 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:19:57.475331 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:19:58.484324 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41148.
May 06 13:20:04.171107 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:20:04.195868 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:20:04.196284 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:20:04.252781 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:20:04.253164 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:20:04.254165 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:20:04.254940 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:20:04.275786 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:20:04.281983 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for user f2a52370b57248648518f82974a62a91 and project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:20:04.296643 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 97ea841a-74e9-45c6-bb6a-4af74ac94d21] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:20:04.298001 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:20:04.298609 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:20:04.309794 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 97ea841a-74e9-45c6-bb6a-4af74ac94d21] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:20:04.311588 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:20:04.312313 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:20:04.350396 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:20:04.350725 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc0b-d25f-43e9-b83d-88f0ebeccaeb tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:20:10.267953 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:20:11.277282 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41210.
May 06 13:20:21.816936 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:20:22.826032 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41250.
May 06 13:20:33.340336 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:20:34.354151 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41254.
May 06 13:20:53.979071 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:20:54.989451 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41262.
May 06 13:20:59.280830 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:21:30.018400 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:21:31.233248 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:21:45.433177 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:22:33.368128 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:22:34.385045 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41368.
May 06 13:22:44.540473 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:22:44.568746 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:22:44.569210 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:22:44.627414 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:22:44.627992 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:22:44.628798 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:22:44.629547 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:22:44.649719 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:22:44.654762 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for user f2a52370b57248648518f82974a62a91 and project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:22:44.672166 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 8b2b9efd-4cbf-408b-898e-040ca4bf2bdd] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:22:44.673694 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:22:44.674365 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:22:44.687039 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 8b2b9efd-4cbf-408b-898e-040ca4bf2bdd] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:22:44.689014 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:22:44.689996 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:22:44.724824 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:22:44.725223 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-778811ef-a69b-472b-aead-b2f4f054abff tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:22:58.484981 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:22:59.493753 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41486.
May 06 13:23:11.277914 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:23:12.287160 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41508.
May 06 13:23:12.491666 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:23:13.607418 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:23:22.826025 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:23:23.834449 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41514.
May 06 13:24:03.599382 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c8fb983a-c58a-4c64-97c3-ca6590f07c2f tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method migrate_server {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:24:03.600188 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c8fb983a-c58a-4c64-97c3-ca6590f07c2f tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:24:03.600860 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c8fb983a-c58a-4c64-97c3-ca6590f07c2f tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:24:03.866351 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-c8fb983a-c58a-4c64-97c3-ca6590f07c2f tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 8b2b9efd-4cbf-408b-898e-040ca4bf2bdd] Restricting to cell ac569716-85fb-4a25-8496-76082665ff15(cell1) while migrating {{(pid=94343) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}}
May 06 13:24:04.214750 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-c8fb983a-c58a-4c64-97c3-ca6590f07c2f tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Created allocations for migration 6ab59800-87ae-4252-bf2e-10c2d27188ec on 7998c436-6cf7-4b43-8830-9e8edbb9dd6d {{(pid=94343) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}}
May 06 13:24:04.440614 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.tasks.migrate [None req-c8fb983a-c58a-4c64-97c3-ca6590f07c2f tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 8b2b9efd-4cbf-408b-898e-040ca4bf2bdd] Calling prep_resize with selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [Selection(allocation_request='{"allocations": {"df4c24a4-6db6-4618-b10d-1b3bc259f029": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["df4c24a4-6db6-4618-b10d-1b3bc259f029"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=ac569716-85fb-4a25-8496-76082665ff15,compute_node_uuid=df4c24a4-6db6-4618-b10d-1b3bc259f029,limits=SchedulerLimits,nodename='n-h2-840842-1',service_host='n-h2-840842-1')] {{(pid=94343) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}}
May 06 13:24:19.290072 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:24:54.991165 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:24:56.001329 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41630.
May 06 13:25:05.442899 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:25:34.491251 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:25:34.518015 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:25:34.518464 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:25:34.567929 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:25:34.568204 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:25:34.568864 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:25:34.569286 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:25:34.586416 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:25:34.591215 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for user f2a52370b57248648518f82974a62a91 and project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:25:34.602693 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 5051e20f-8df7-471d-bff7-4b96a937aa13] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:25:34.603494 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:25:34.603771 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:25:34.612265 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 5051e20f-8df7-471d-bff7-4b96a937aa13] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:25:34.613741 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:25:34.614144 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:25:34.647827 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:25:34.648256 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-fb8b4349-3157-490b-bb15-d7db827f5c72 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:26:12.288111 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:26:13.295908 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41834.
May 06 13:26:23.835009 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:26:24.847279 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41840.
May 06 13:26:32.502012 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:26:33.617200 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:26:34.379433 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:26:35.396815 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41852.
May 06 13:26:59.496122 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:27:00.505517 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41876.
May 06 13:27:34.353710 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:27:35.370615 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41902.
May 06 13:27:39.300066 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:27:56.001257 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:27:57.011150 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 41916.
May 06 13:28:20.267888 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:28:20.302188 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:28:20.303129 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:28:20.385944 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:28:20.387000 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:28:20.387732 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:28:20.388118 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:28:20.412774 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:28:20.419709 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Getting quotas for user f2a52370b57248648518f82974a62a91 and project 5997d797a49a4c4fa54b8d79308afea2. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:28:20.435759 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 9b1fe181-c625-43f3-aa31-d7ee4484ae81] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:28:20.436722 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:28:20.437209 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:28:20.448463 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] [instance: 9b1fe181-c625-43f3-aa31-d7ee4484ae81] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:28:20.450923 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:28:20.452931 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:28:20.494947 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:28:20.495348 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-c704e345-283e-4385-af40-89a1c81826a2 tempest-TestNetworkAdvancedServerOps-1863923871 tempest-TestNetworkAdvancedServerOps-1863923871-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:28:25.452575 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:29:13.296812 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:29:14.306198 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42126.
May 06 13:29:24.847380 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:29:25.856319 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42134.
May 06 13:30:16.782267 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:30:16.807988 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:30:16.808386 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:30:16.860140 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:30:16.860541 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:30:16.861304 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:30:16.861699 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:30:16.877593 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Getting quotas for project 5d0c68010c2145458955a6e381a45c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:30:16.883230 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Getting quotas for user 721c35d4092f4f379e35286a1d24f969 and project 5d0c68010c2145458955a6e381a45c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:30:16.894066 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] [instance: ec2bf467-7b9e-41ab-b6a0-2b70688ec0c6] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:30:16.895068 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:30:16.895984 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:30:16.903559 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] [instance: ec2bf467-7b9e-41ab-b6a0-2b70688ec0c6] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:30:16.904791 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:30:16.905204 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:30:16.940332 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:30:16.940811 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-4b1f45d3-7bdc-490d-b027-13bc9f7a21a9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:30:35.391043 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:30:36.413615 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42406.
May 06 13:30:59.308779 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:31:00.506249 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:31:01.515240 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42418.
May 06 13:31:32.514558 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:31:33.628448 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:31:45.461956 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:32:14.306752 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:32:15.317248 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42442.
May 06 13:32:25.857016 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:32:26.866996 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42446.
May 06 13:32:35.365085 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:32:36.379774 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42450.
May 06 13:32:57.014048 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:32:58.025556 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42452.
May 06 13:33:10.038250 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:33:11.251437 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:33:29.313526 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d3b7b245-8861-4b8d-b0ce-778168d25f16 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method unshelve_instance {{(pid=94343) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:33:29.314253 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3b7b245-8861-4b8d-b0ce-778168d25f16 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:33:29.314484 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-d3b7b245-8861-4b8d-b0ce-778168d25f16 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:33:29.735703 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d3b7b245-8861-4b8d-b0ce-778168d25f16 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] [instance: ec2bf467-7b9e-41ab-b6a0-2b70688ec0c6] Requesting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) during scheduling {{(pid=94343) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}}
May 06 13:33:30.242287 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-d3b7b245-8861-4b8d-b0ce-778168d25f16 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:33:30.251064 n-d-840842-1 nova-conductor[94343]: DEBUG nova.objects.instance [None req-d3b7b245-8861-4b8d-b0ce-778168d25f16 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lazy-loading 'flavor' on Instance uuid ec2bf467-7b9e-41ab-b6a0-2b70688ec0c6 {{(pid=94343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 13:34:19.323414 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:35:05.472606 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:35:15.316766 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:35:16.327405 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42738.
May 06 13:35:26.866929 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:35:27.877139 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42746.
May 06 13:35:36.375066 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:35:36.402920 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:35:37.390773 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42754.
May 06 13:35:37.419716 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42756.
May 06 13:35:58.026187 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:35:59.035847 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42932.
May 06 13:36:01.519251 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:36:02.528481 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 42956.
May 06 13:36:05.797438 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Took 2.24 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:36:05.822113 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:36:05.822500 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:36:05.883628 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:36:05.884141 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:36:05.884852 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:36:05.885269 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:36:05.900263 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Getting quotas for project 5d0c68010c2145458955a6e381a45c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:36:05.904890 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Getting quotas for user 721c35d4092f4f379e35286a1d24f969 and project 5d0c68010c2145458955a6e381a45c1b. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:36:05.915980 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] [instance: d32735c2-cb6f-4179-a204-a2d710b90805] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:36:05.916890 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:36:05.917320 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:36:05.927879 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] [instance: d32735c2-cb6f-4179-a204-a2d710b90805] block_device_mapping [BlockDeviceMapping(attachment_id=c553a326-4840-4472-b219-35b5ee6bb237,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='d2769f21-4b82-49d7-98a9-a758c412ab63',volume_size=1,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:36:05.929879 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:36:05.930513 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:36:05.964553 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:36:05.964953 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-62d16de0-b6da-4b0e-864a-c075bef087b9 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:36:32.527871 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:36:33.640269 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:37:39.333952 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:38:10.051852 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:38:11.262530 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:38:16.326660 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:38:17.338843 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43082.
May 06 13:38:25.482899 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:38:27.878761 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:38:28.887988 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43092.
May 06 13:38:37.385857 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:38:37.413345 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:38:38.411198 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43114.
May 06 13:38:38.426903 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43116.
May 06 13:38:42.231769 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-34e71328-3742-4127-8364-2c064e430a78 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Targeting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) for conductor method unshelve_instance {{(pid=94344) wrapper /opt/stack/nova/nova/conductor/manager.py:91}}
May 06 13:38:42.232289 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34e71328-3742-4127-8364-2c064e430a78 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:38:42.232637 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-34e71328-3742-4127-8364-2c064e430a78 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:38:42.394251 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-34e71328-3742-4127-8364-2c064e430a78 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] [instance: d32735c2-cb6f-4179-a204-a2d710b90805] Requesting cell ac569716-85fb-4a25-8496-76082665ff15(cell1) during scheduling {{(pid=94344) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}}
May 06 13:38:42.719938 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-34e71328-3742-4127-8364-2c064e430a78 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:38:42.729435 n-d-840842-1 nova-conductor[94344]: DEBUG nova.objects.instance [None req-34e71328-3742-4127-8364-2c064e430a78 tempest-TestShelveInstance-1238307491 tempest-TestShelveInstance-1238307491-project] Lazy-loading 'flavor' on Instance uuid d32735c2-cb6f-4179-a204-a2d710b90805 {{(pid=94344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}}
May 06 13:39:02.529304 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:39:03.537459 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43184.
May 06 13:39:52.537623 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:39:53.649723 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:40:59.040280 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:40:59.343327 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:41:00.048722 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43420.
May 06 13:41:01.245003 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=94343) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:41:01.270454 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:41:01.270853 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:41:01.329753 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:41:01.330157 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:41:01.330878 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:41:01.331260 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:41:01.347470 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Getting quotas for project f51e4ce88c184fd3a06c93658f2dc168. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:41:01.352401 n-d-840842-1 nova-conductor[94343]: DEBUG nova.quota [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Getting quotas for user e7193eff238b4036becd9cf8f3d7566b and project f51e4ce88c184fd3a06c93658f2dc168. Resources: {'cores', 'ram', 'instances'} {{(pid=94343) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:41:01.363826 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] [instance: aaee3d0f-1093-42e3-88c5-cf88833a5c6e] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94343) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:41:01.364800 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:41:01.365205 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:41:01.374312 n-d-840842-1 nova-conductor[94343]: DEBUG nova.conductor.manager [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] [instance: aaee3d0f-1093-42e3-88c5-cf88833a5c6e] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='f7eb5a00-e178-43ed-b780-ad328bc10480',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94343) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:41:01.375851 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:41:01.376407 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:41:01.411390 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:41:01.411840 n-d-840842-1 nova-conductor[94343]: DEBUG oslo_concurrency.lockutils [None req-73682600-3168-4379-8f24-1c9b2dedb97e tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:41:17.337899 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:41:18.348353 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43484.
May 06 13:41:28.889077 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:41:29.898821 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43488.
May 06 13:41:30.061920 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:41:31.272063 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:41:38.408195 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:41:39.424901 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43504.
May 06 13:41:45.491956 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:43:03.540697 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:43:04.548587 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43526.
May 06 13:43:38.424263 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:43:39.439160 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43536.
May 06 13:44:00.050440 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:44:01.060345 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43580.
May 06 13:44:15.572995 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94344) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}}
May 06 13:44:15.596806 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:44:15.597248 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:44:15.668169 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:44:15.668574 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:44:15.669425 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:44:15.669818 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:44:15.687371 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Getting quotas for project f51e4ce88c184fd3a06c93658f2dc168. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:387}}
May 06 13:44:15.692070 n-d-840842-1 nova-conductor[94344]: DEBUG nova.quota [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Getting quotas for user e7193eff238b4036becd9cf8f3d7566b and project f51e4ce88c184fd3a06c93658f2dc168. Resources: {'cores', 'ram', 'instances'} {{(pid=94344) _get_quotas /opt/stack/nova/nova/quota.py:377}}
May 06 13:44:15.703016 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] [instance: b4aa1a08-7268-4700-8139-a4bf9944b420] Selected host: n-h1-840842-1; Selected node: n-h1-840842-1; Alternates: [('n-h2-840842-1', 'n-h2-840842-1')] {{(pid=94344) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}}
May 06 13:44:15.704052 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:44:15.704478 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:44:15.712410 n-d-840842-1 nova-conductor[94344]: DEBUG nova.conductor.manager [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] [instance: b4aa1a08-7268-4700-8139-a4bf9944b420] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='4508fd24-da0c-411d-b8bf-22ba137fa580',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94344) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}}
May 06 13:44:15.714397 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:44:15.714887 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:44:15.747620 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 06 13:44:15.748048 n-d-840842-1 nova-conductor[94344]: DEBUG oslo_concurrency.lockutils [None req-3b4a1b24-c569-4f48-913b-d2b46435f3fa tempest-TestSnapshotPattern-2119267684 tempest-TestSnapshotPattern-2119267684-project] Lock "ac569716-85fb-4a25-8496-76082665ff15" released by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 06 13:44:18.349033 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:44:19.356611 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43756.
May 06 13:44:19.357273 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:44:29.898921 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:44:30.907487 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43786.
May 06 13:45:05.503128 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:46:04.551983 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:46:05.562799 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43842.
May 06 13:46:30.072978 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:46:31.282044 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:46:32.551278 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:46:33.662443 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:46:39.420501 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:46:39.434531 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:46:40.435672 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43874.
May 06 13:46:40.448675 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43876.
May 06 13:47:01.060502 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:47:02.069266 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 43882.
May 06 13:47:19.358783 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:47:20.371466 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44018.
May 06 13:47:30.908993 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:47:31.917545 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44164.
May 06 13:47:39.364535 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:48:25.512127 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:49:05.563471 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:49:06.572807 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44248.
May 06 13:49:40.431597 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:49:40.444355 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:49:41.446134 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44260.
May 06 13:49:41.457450 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44262.
May 06 13:49:50.082701 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:49:51.291908 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:49:52.561573 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:49:53.672197 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:50:02.070186 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:50:03.080370 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44284.
May 06 13:50:20.368881 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:50:21.376644 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44288.
May 06 13:50:31.916991 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:50:32.926825 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44290.
May 06 13:50:59.372812 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:51:45.521480 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:52:06.574269 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:52:07.583758 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44316.
May 06 13:52:41.441817 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:52:41.454268 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:52:42.457646 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44330.
May 06 13:52:42.470041 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44332.
May 06 13:53:03.080327 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:53:04.092660 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44336.
May 06 13:53:10.092473 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:53:11.299548 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:53:12.570500 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:53:13.681698 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:53:21.377926 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:53:22.387811 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44356.
May 06 13:53:32.928017 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:53:33.936832 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44362.
May 06 13:54:19.382258 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:55:05.531912 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:55:07.585456 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:55:08.594829 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44368.
May 06 13:55:42.453750 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:55:42.465093 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] AMQP server on 10.222.0.41:5672 is unreachable: <RecoverableConnectionError: unknown error>. Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: <RecoverableConnectionError: unknown error>
May 06 13:55:43.470437 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [1e2175fe-8e63-4233-8481-4923844ca07f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44378.
May 06 13:55:43.479990 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [cab17e69-8c63-44a5-8c9e-19a4b80f3648] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44380.
May 06 13:56:04.092392 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:56:05.101855 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [6883b659-21ec-46df-ac03-131bde83b7b0] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44382.
May 06 13:56:22.388409 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:56:23.396113 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [172f29d3-d783-4ccf-b993-7335dcc9dec2] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44384.
May 06 13:56:30.112549 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:56:31.309898 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:56:32.579797 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:56:33.691237 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:56:33.938855 n-d-840842-1 nova-conductor[94344]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:56:34.949223 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8621de2-3fc3-4081-ab19-5b1d38103d4f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44404.
May 06 13:57:39.391261 n-d-840842-1 nova-conductor[94344]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer
May 06 13:58:08.595397 n-d-840842-1 nova-conductor[94343]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] AMQP server on 10.222.0.41:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection
May 06 13:58:09.603909 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] [9503d170-976d-479a-bb23-cd53ca9d5c1c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 44422.
May 06 13:58:25.540699 n-d-840842-1 nova-conductor[94343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer